-- Logs begin at Thu 2022-09-08 00:33:37 UTC, end at Thu 2022-09-08 01:30:42 UTC. -- Sep 08 01:04:47.446537 dv-cinder-847733-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 01:04:47.455046 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 01:04:47 2022] *** Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: nodename: dv-cinder-847733-3-iscsi Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: machine: x86_64 Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: clock source: unix Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: pcre jit disabled Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: detected number of CPU cores: 4 Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: current working directory: / Sep 08 01:04:47.458186 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: detected binary path: /usr/bin/uwsgi-core Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: your processes number limit is 47680 Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: your memory page size is 4096 bytes Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: detected max file descriptor number: 2048 Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: lock engine: pthread robust mutexes Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: thunder lock: enabled Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 01:04:47.458884 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 01:04:47.498128 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: Python main interpreter initialized at 0x55d03e53f9c0 Sep 08 01:04:47.498128 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: python threads support enabled Sep 08 01:04:47.498128 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: your server socket listen backlog is limited to 100 connections Sep 08 01:04:47.498128 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: your mercy for graceful operations on workers is 90 seconds Sep 08 01:04:47.498542 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 01:04:47.498625 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: *** Operational MODE: preforking *** Sep 08 01:04:47.498846 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: *** uWSGI is running in multiple interpreter mode *** Sep 08 01:04:47.498846 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: spawned uWSGI master process (pid: 105703) Sep 08 01:04:47.499045 dv-cinder-847733-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 01:04:47.500414 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: spawned uWSGI worker 1 (pid: 105705, cores: 1) Sep 08 01:04:47.500414 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: spawned uWSGI worker 2 (pid: 105706, cores: 1) Sep 08 01:04:47.500414 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 01:04:48.160331 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 01:04:48.164256 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 01:04:49.257627 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:04:49.257627 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: from cryptography.utils import int_from_bytes Sep 08 01:04:49.258255 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:04:49.258255 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: from cryptography.utils import int_from_bytes Sep 08 01:04:49.261601 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:04:49.261601 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: from cryptography.utils import int_from_bytes Sep 08 01:04:49.262277 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:04:49.262277 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: from cryptography.utils import int_from_bytes Sep 08 01:04:51.768018 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 01:04:51.768917 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 01:04:51.768917 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 01:04:51.769348 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 01:04:51.769610 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 01:04:51.769767 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 01:04:51.770192 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.770291 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 01:04:51.770375 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.770543 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 01:04:51.770639 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.770906 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 01:04:51.771005 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.771162 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 01:04:51.771248 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.771529 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.771612 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.771849 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.771942 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772188 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772278 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772511 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772610 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772768 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.772861 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773089 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773195 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773411 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-3-iscsi {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773731 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.773823 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774034 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774127 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774315 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774401 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774632 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774723 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.774934 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.775018 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-3-iscsi {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.775254 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.775346 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.775557 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.775681 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.776059 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777318 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777318 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777569 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777690 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777817 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.777938 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778067 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778191 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778333 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778333 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778572 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778719 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778846 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.778974 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779096 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779223 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779345 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779475 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779603 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779730 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779851 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.779980 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-3-iscsi {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780101 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780283 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780419 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780540 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780672 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780883 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.780998 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781117 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781246 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781368 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781501 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-3-iscsi {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781624 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781750 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.781874 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782007 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782129 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782256 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782379 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782589 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782731 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.782903 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783040 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783213 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783355 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783538 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783664 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783863 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.783995 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.784717 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.784854 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785057 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785220 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785644 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785837 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.785967 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786142 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786274 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786391 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786520 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786686 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.786824 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787009 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787150 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787326 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787452 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787644 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787780 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.787907 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788038 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788190 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788327 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788458 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788582 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788758 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.788890 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789065 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789189 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789505 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789674 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789798 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.789927 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790061 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790226 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790351 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790549 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790676 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790850 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.790990 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791154 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791279 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791458 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791580 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791766 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.791900 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792073 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792231 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792404 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792528 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792712 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.792846 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793020 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793145 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793337 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793472 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793641 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793771 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.793964 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794087 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794273 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794404 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794580 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794704 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.794899 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795029 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795217 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795342 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795524 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795648 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795826 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.795961 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796181 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796311 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796458 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796582 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796786 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.796918 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797090 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797223 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797355 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797477 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797626 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797758 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.797928 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798063 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798244 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798370 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798549 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798682 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798853 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.798987 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.799157 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.799287 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.799454 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.799576 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.799755 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.800466 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.800756 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.800882 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801173 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801303 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801440 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801565 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801687 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.801866 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802004 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802133 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802265 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802394 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802516 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802680 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802828 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.802994 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803127 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803304 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803429 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803613 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803737 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.803920 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804057 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804249 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804377 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804547 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804671 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804853 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.804986 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805162 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805287 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805482 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805606 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805805 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.805938 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806115 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806239 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806418 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806535 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806731 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.806864 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807017 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807140 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807320 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807444 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807629 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807776 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.807933 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808057 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808258 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808391 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808568 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808702 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.808873 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809004 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809178 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809303 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809483 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809610 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809787 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.809912 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810091 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810215 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810389 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810513 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810690 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810814 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.810992 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811117 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811299 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811436 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811586 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811719 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.811887 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812010 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812212 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812338 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812658 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812825 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.812970 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813128 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813252 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813431 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813555 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813732 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.813870 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.814052 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.814176 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.814374 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.814497 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.814684 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.814817 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.814990 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.815115 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.815298 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.815458 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816075 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816306 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:04:51.816306 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816550 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816672 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816800 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.816964 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817090 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817277 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817408 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817592 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817717 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.817904 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818038 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818223 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818347 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818541 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818667 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818857 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.818989 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819175 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819299 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819488 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819622 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819804 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.819929 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820115 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820260 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820457 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820583 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820779 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.820897 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821099 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821223 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821413 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821547 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821728 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.821853 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822050 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822181 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822364 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822498 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822685 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.822810 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823006 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823131 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823319 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823454 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823631 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823769 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.823942 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824067 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824317 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824460 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824632 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824756 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.824947 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825073 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825268 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825404 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825581 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825706 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.825892 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826016 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826206 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826331 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826519 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826645 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826833 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.826958 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827145 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827279 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827456 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827581 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827768 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.827902 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828092 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828233 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828435 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828571 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828747 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.828872 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829069 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829192 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829360 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829486 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829669 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829805 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.829978 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830111 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830289 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830414 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830594 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830728 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.830899 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831017 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831246 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831466 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831680 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831835 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.831835 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832076 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832246 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832369 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832489 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832661 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832789 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.832970 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833096 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833305 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833441 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833613 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833748 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.833925 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834060 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834238 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834373 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834551 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834677 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834856 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.834980 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835165 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835298 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835476 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835602 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835782 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.835919 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836090 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836245 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836425 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836551 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836732 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.836859 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837045 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837171 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837348 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837471 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837650 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837773 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.837964 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838088 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838275 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838399 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838579 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838702 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.838889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839014 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839192 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839316 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839499 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839624 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839809 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.839942 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840118 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840302 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840454 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840587 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840767 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.840904 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841080 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841205 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841402 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841534 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841712 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.841836 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842022 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842148 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842322 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842459 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842635 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842770 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.842938 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843063 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843240 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843374 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843542 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843849 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.843985 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844201 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844332 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844465 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844587 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844763 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.844889 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845064 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845202 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845367 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845491 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845677 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845810 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.845981 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.846114 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.846281 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.846405 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.846578 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.847198 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.847385 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.847593 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.847762 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.847886 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848163 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848380 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848507 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848717 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.848843 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849024 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849161 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849331 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849468 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849643 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849774 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.849958 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850096 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850268 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850394 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850578 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850704 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.850889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851022 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851197 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851323 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851514 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851640 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851823 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.851956 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852169 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852309 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852465 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852590 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852777 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.852902 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853089 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853221 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853404 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853529 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853706 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.853840 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854020 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854152 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854328 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854458 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854653 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854780 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.854964 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855089 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855283 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855406 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855586 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855720 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.855896 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856027 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856228 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856368 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856539 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856666 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856849 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.856973 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857158 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857294 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857476 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857601 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857784 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.857917 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858093 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858292 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858416 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858539 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858705 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.858832 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859012 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859146 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859329 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859452 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859753 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.859941 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860068 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860270 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860395 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860594 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860730 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.860904 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861031 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861213 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861341 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861516 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861647 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861830 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.861957 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.862139 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.862264 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863051 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863178 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863385 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863697 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.863823 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864011 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864129 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864355 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864482 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864668 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864795 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.864978 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865114 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865284 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865410 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865597 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865723 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.865906 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866040 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866211 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866344 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866521 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866649 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.866958 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867132 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867258 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867441 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867565 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867750 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.867882 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868058 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868202 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868392 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868529 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868698 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.868873 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869004 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869313 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869446 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869618 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869744 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.869924 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870051 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870228 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870354 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870532 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870657 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870858 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.870983 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871160 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871276 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871467 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871591 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871774 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.871906 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872082 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872277 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872410 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872534 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872717 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.872848 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873033 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873166 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873349 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873472 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873659 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873782 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.873966 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874100 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874277 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874403 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874587 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874711 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.874893 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875030 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875203 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875328 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875516 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875648 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875820 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.875945 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.876210 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.876339 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.876472 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.876595 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.876754 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877021 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877157 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877340 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877466 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877666 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.877944 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878080 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878306 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878432 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878627 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878827 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.878961 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879140 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879265 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879455 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879594 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879776 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.879901 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.880249 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.880377 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.880567 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.880692 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.880875 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881015 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881185 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881312 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881491 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881654 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881789 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.881981 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882116 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882318 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882487 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882653 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882780 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.882972 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883174 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883307 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883428 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883571 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883697 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.883877 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884012 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884196 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884326 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884497 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884622 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884804 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.884941 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885106 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885238 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885411 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885535 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885712 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.885845 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886019 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886144 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886326 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886451 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.886996 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887189 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887313 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887491 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887615 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887801 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.887926 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888121 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888272 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888452 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888578 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888778 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.888904 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889090 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889223 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889397 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889522 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889700 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.889835 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890003 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890128 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890315 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890452 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890620 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890752 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.890922 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891048 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891229 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891369 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891536 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891654 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891839 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.891965 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892169 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892311 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892481 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892607 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892788 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.892922 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.893100 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.893238 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.893401 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.893528 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.894247 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.894375 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.894562 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.894748 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.894875 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895072 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895199 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895388 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895528 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895697 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.895823 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896003 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896147 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896342 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896482 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896654 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896789 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.896958 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897090 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897268 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897401 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897574 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897707 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.897876 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898001 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898180 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898312 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898484 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898622 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898788 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.898921 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899091 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899217 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899397 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899522 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899699 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.899831 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900015 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900194 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900331 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900455 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900640 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900767 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.900942 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901068 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901249 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901382 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901551 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901683 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901851 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.901968 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902156 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902280 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902473 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902605 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902779 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.902906 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903082 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903206 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903390 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903526 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903690 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903814 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.903991 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904116 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904320 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904456 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904620 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904751 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.904915 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905041 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905218 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905352 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905519 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905645 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905820 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.905954 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906120 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906247 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906422 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906546 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906732 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.906856 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907031 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907163 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907332 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907456 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907631 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907761 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.907932 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908057 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908262 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908390 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908586 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908733 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.908896 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909029 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909245 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909399 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909553 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909688 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909857 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.909995 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910165 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910290 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910479 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910613 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910784 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.910916 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911101 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911227 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911407 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911577 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911721 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.911847 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912023 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912166 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912369 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912501 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912658 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912783 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.912959 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913090 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913268 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913393 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913578 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913700 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.913894 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914028 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914199 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914324 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914503 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914619 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914812 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.914936 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915123 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915247 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915428 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915551 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915737 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.915861 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916047 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916204 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916384 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916695 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.916829 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917002 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917125 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917434 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917618 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917754 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.917920 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918053 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918230 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918363 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918540 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918674 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918843 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.918973 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919153 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919276 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919459 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919591 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919761 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.919886 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920065 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920213 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920393 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920525 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920699 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.920825 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921003 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921126 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921329 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921455 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921639 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921765 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.921943 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922253 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922379 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922558 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922690 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.922868 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923007 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923173 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923297 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923497 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923627 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923800 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.923934 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.924219 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.924358 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.924529 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.924654 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.925358 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.925502 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.925670 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.925944 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926194 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926314 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926445 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926568 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926689 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926860 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.926987 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927163 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927301 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927465 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927590 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927767 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.927896 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928087 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928271 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928396 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928523 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928720 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.928846 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929106 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929231 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929415 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929540 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929720 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.929843 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930028 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930155 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930351 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930475 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930657 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930795 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.930978 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931109 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931330 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931460 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931654 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931787 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.931959 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932086 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932296 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932423 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932605 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932738 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.932927 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933070 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933247 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933373 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933556 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933688 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.933874 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934008 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934177 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934303 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934499 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934626 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934821 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.934955 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935134 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935258 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935455 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935578 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935770 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.935907 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936085 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936230 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936419 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936537 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936744 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.936871 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937069 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937194 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937385 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937503 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937698 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.937824 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938010 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938142 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938314 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938440 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938618 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938744 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.938938 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939063 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939243 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939377 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939552 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939681 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939861 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.939986 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.940189 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.940330 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.940561 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.940833 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.940986 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941147 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941271 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941402 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941525 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941656 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941786 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.941909 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942072 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942199 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942382 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942505 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942687 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942814 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.942991 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943123 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943313 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943444 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943617 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943743 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.943925 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944049 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944251 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944377 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944556 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944681 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.944888 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945013 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945191 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945315 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945510 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945635 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945820 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.945945 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946126 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946258 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946432 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946566 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946739 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.946864 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947077 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947200 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947384 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947515 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947696 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.947827 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948012 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948166 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948363 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948501 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948667 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948792 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.948974 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949106 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949284 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949418 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949588 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949713 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.949895 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950020 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950199 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950325 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950506 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950631 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.950874 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951115 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951253 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951426 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951551 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951742 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.951868 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952049 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952243 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952369 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952498 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952676 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952802 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.952990 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953124 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953294 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953417 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953598 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953724 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.953900 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954024 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954225 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954351 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954532 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954657 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954843 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.954967 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955156 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955281 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955463 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955588 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955769 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.955895 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.956599 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.956746 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.956952 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957077 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957257 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957383 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957586 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957711 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.957899 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958038 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958206 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958330 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958523 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958648 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958839 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.958974 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959156 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959282 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959470 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959675 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959800 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.959997 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960122 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960332 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960457 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960647 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960772 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.960943 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961071 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961258 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961384 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961569 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961708 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.961878 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962137 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962256 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962474 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962599 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962779 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.962905 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963099 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963237 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963417 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963542 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963737 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.963863 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964052 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964206 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964393 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964532 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964706 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.964838 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965019 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965142 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965329 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965462 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965659 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965785 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.965984 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966122 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966289 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966416 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966617 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966741 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.966901 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967027 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967224 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967348 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967511 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967636 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967822 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.967948 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968153 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968281 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968467 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968592 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968778 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.968916 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969087 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969219 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969398 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969522 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969707 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.969841 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970029 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970153 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970341 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970463 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970657 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970789 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.970968 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971091 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971277 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971407 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971589 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971771 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.971958 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.972283 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.972502 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.972629 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.972823 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.972955 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973158 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973284 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973486 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973611 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973810 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.973936 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974121 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974284 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974444 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974651 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974778 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.974968 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975094 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975303 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975428 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975630 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975765 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.975941 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976074 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976270 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976398 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976594 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976721 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.976904 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977030 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977205 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977332 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977521 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977656 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.977830 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.978121 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.978359 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.978494 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.978703 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.978842 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979019 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979146 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979342 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979483 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979646 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979778 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.979968 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980094 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980300 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980438 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980624 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980833 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.980960 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981181 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981306 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981500 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981628 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981813 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.981938 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982116 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982254 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982421 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982541 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982731 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.982856 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983038 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983177 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983341 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983466 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983645 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983770 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.983943 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984080 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984284 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984409 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984593 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984718 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.984895 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985032 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985199 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985325 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985508 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985633 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985810 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.985944 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986114 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986239 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986416 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986541 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986717 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.986842 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.987027 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.987151 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.987843 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988006 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988183 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988310 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988471 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988597 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988780 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.988908 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989087 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989213 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989392 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989518 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989705 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.989839 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990020 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990145 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990324 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990448 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990624 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990761 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.990927 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991058 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991233 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991357 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991556 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991690 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991869 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.991995 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992194 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992320 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992523 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992654 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.992954 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.993135 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.993358 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.993498 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.993697 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.993823 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994021 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994155 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994357 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994490 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994670 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994795 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.994988 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995112 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995296 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995429 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995606 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995839 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.995966 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996200 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996329 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996527 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996653 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996846 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.996970 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997158 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997361 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997486 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997608 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997763 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.997889 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998070 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998202 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998377 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998501 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998688 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998813 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.998994 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999136 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999302 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999433 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999608 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999733 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:51.999917 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000044 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000249 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000375 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000561 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000687 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.000873 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001001 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001183 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001310 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001493 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001618 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001802 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.001936 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002114 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002239 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002421 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002558 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002728 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.002851 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003130 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003265 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003444 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003581 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003758 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.003934 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004087 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004285 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004411 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004606 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004769 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.004928 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.005241 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.005365 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.005557 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.005683 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.005869 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006003 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006182 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006314 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006502 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006628 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006835 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.006962 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.007152 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.007270 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.007460 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.007594 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.007788 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008098 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008241 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008450 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008586 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008758 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.008885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009082 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009214 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009397 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009530 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009700 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.009833 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010006 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010132 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010312 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010449 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010622 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010755 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.010941 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.011067 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.011250 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.011390 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.011553 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.011926 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012105 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012264 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012437 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012563 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012739 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.012857 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013044 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013188 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013347 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013481 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013649 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013774 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.013956 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014091 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014256 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014381 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014558 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014681 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014860 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.014986 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015163 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015290 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015464 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015587 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015763 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.015895 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016065 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016218 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016395 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016521 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016697 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016822 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.016996 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017121 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017296 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017419 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017598 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017725 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.017899 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.018023 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.018204 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.018338 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.018508 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.019208 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.019385 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.019587 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.019785 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.019924 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020048 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020208 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020334 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020454 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020575 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020709 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020832 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.020952 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021147 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021281 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021482 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021617 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021796 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.021927 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022116 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022247 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022425 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022551 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022734 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.022850 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023043 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023169 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023350 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023478 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023658 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023784 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.023971 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024095 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024309 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024438 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024614 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024738 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.024940 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025066 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025251 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025384 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025567 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025693 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.025880 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026013 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026191 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026315 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026503 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.026815 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027136 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027256 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027424 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027548 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027737 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.027871 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028048 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028390 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028516 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028703 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.028830 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029016 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029140 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029330 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029447 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029647 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029773 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.029957 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030080 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030275 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030408 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030585 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030709 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.030897 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031020 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031216 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031354 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031529 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031655 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031843 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.031975 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032183 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032325 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032505 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032631 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032821 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.032937 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.033134 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.033268 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.033438 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.033575 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.033699 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 01:04:52.033827 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.034089 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.034484 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.034939 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.035292 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.035626 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.035943 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.036285 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.036594 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:04:52.036838 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 01:04:52.187886 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO dbcounter [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Registered counter for database nova_api Sep 08 01:04:52.192888 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO dbcounter [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Registered counter for database nova_api Sep 08 01:04:52.214907 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.216747 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_db.sqlalchemy.engines [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.221509 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writer thread running {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.223698 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writer thread running {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.280005 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.context [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),399af677-d3da-4cd3-8ba5-6488df620aa9(cell1) {{(pid=105706) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 01:04:52.281754 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.context [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),399af677-d3da-4cd3-8ba5-6488df620aa9(cell1) {{(pid=105705) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 01:04:52.284071 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:04:52.285317 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:04:52.286148 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:04:52.286625 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:04:52.287410 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:04:52.288176 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:04:52.288361 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:04:52.288603 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:04:52.288909 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:04:52.289353 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:04:52.290561 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_concurrency.lockutils [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:04:52.291333 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:04:52.292577 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO dbcounter [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Registered counter for database nova_cell0 Sep 08 01:04:52.293421 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO dbcounter [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Registered counter for database nova_cell0 Sep 08 01:04:52.296603 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO dbcounter [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Registered counter for database nova_cell1 Sep 08 01:04:52.297400 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO dbcounter [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Registered counter for database nova_cell1 Sep 08 01:04:52.304714 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.306561 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_db.sqlalchemy.engines [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.309519 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writer thread running {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.310571 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_db.sqlalchemy.engines [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.312107 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writer thread running {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.454111 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writer thread running {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.462179 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.462680 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO dbcounter [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Registered counter for database nova_cell0 Sep 08 01:04:52.467753 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writer thread running {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.469747 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_db.sqlalchemy.engines [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.475024 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writer thread running {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.477198 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO dbcounter [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Registered counter for database nova_cell0 Sep 08 01:04:52.486339 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG oslo_db.sqlalchemy.engines [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:04:52.491803 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writer thread running {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:04:52.813650 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: WARNING keystonemiddleware.auth_token [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:04:52.816287 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: WARNING keystonemiddleware.auth_token [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:04:52.821325 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: WARNING keystonemiddleware.auth_token [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:04:52.823524 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: WARNING keystonemiddleware.auth_token [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:04:53.165815 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: WARNING keystonemiddleware.auth_token [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:04:53.169284 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: WARNING keystonemiddleware.auth_token [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:04:53.171724 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: WARNING keystonemiddleware.auth_token [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:04:53.175821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: WARNING keystonemiddleware.auth_token [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:04:53.177707 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d03e53f9c0 pid: 105706 (default app) Sep 08 01:04:53.179796 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:04:53.181004 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-7f1b846f-7ab2-49ed-8d01-5eb0cdea3030 None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Sep 08 01:04:53.181234 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d03e53f9c0 pid: 105705 (default app) Sep 08 01:04:53.181420 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Thu Sep 8 01:04:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:14.726483 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:14.727706 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001963 Sep 08 01:06:14.728095 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:06:14.746496 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_api:SELECT=3 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.748706 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_cell1:SELECT=3 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.750850 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_cell0:SELECT=3 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:14.752116 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_cell0:SELECT=3 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:15.657315 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-5fa1e715-b7d4-4d6e-a030-f9aa88ba92b0 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:15.693594 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-5fa1e715-b7d4-4d6e-a030-f9aa88ba92b0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959520 Sep 08 01:06:15.694307 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 2/3] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 8 01:06:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:18.317191 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:18.318560 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-ad72ab15-0c64-4568-be7c-cb02b5a8f465 None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 08 01:06:18.319880 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 2/4] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:18.787453 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-777016c5-2669-43dc-a819-65b4c7095c2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:18.843511 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-777016c5-2669-43dc-a819-65b4c7095c2b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518646 Sep 08 01:06:18.844707 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 3/5] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:18.860203 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_api:SELECT=3 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:18.861309 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_cell0:SELECT=3 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:18.863457 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_cell1:SELECT=3 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:18.864547 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:19.089772 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-4926fd86-2953-42bf-9fad-afd8dd3290e6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:19.166217 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-4926fd86-2953-42bf-9fad-afd8dd3290e6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.312884 Sep 08 01:06:19.166809 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 3/6] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 8 01:06:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:21.832114 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-777016c5-2669-43dc-a819-65b4c7095c2b admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:21.833211 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-777016c5-2669-43dc-a819-65b4c7095c2b admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Sep 08 01:06:21.833614 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 4/7] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:22.492063 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-0960c92c-6604-45fc-afbf-57f2e2fb59f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "vcpus": 1, "id": "d1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:22.529605 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-0960c92c-6604-45fc-afbf-57f2e2fb59f5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.689586 Sep 08 01:06:22.530318 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 4/8] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:22.543027 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-711eb8b4-89c7-4a18-9627-c4b47fa8f6b7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:22.586147 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-711eb8b4-89c7-4a18-9627-c4b47fa8f6b7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046459 Sep 08 01:06:22.587369 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 5/9] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 8 01:06:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:25.238279 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-0960c92c-6604-45fc-afbf-57f2e2fb59f5 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:25.239223 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-0960c92c-6604-45fc-afbf-57f2e2fb59f5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 08 01:06:25.239636 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:25.668695 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-e93c4796-0a39-4757-b611-070a4be317e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:25.695964 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-e93c4796-0a39-4757-b611-070a4be317e8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.449369 Sep 08 01:06:25.696545 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 6/11] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:25.708761 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-c453483e-5457-4994-935a-d2a0ff8d4e24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:25.738358 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-c453483e-5457-4994-935a-d2a0ff8d4e24 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033228 Sep 08 01:06:25.738994 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 6/12] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 8 01:06:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:06:28.565751 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-e93c4796-0a39-4757-b611-070a4be317e8 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:28.566763 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-e93c4796-0a39-4757-b611-070a4be317e8 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 08 01:06:28.567371 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 7/13] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:28.996879 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-781ecfed-af20-417f-b9b1-46bac9f25fbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "disk": 10, "swap": 0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:29.017975 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-781ecfed-af20-417f-b9b1-46bac9f25fbd admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.444299 Sep 08 01:06:29.018714 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 7/14] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 01:06:29.031241 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-04cd0550-b5ed-46ac-997e-e3de29495442 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:29.059974 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-04cd0550-b5ed-46ac-997e-e3de29495442 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032734 Sep 08 01:06:29.060928 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 8/15] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 8 01:06:29 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:06:31.777846 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-781ecfed-af20-417f-b9b1-46bac9f25fbd admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:31.778862 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-781ecfed-af20-417f-b9b1-46bac9f25fbd admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 08 01:06:31.779280 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 8/16] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:32.204469 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:32.225401 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.438817 Sep 08 01:06:32.225956 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 9/17] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:32.238126 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-591e3d94-7c4b-402a-bb9f-b89f08741647 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:32.263218 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-591e3d94-7c4b-402a-bb9f-b89f08741647 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028700 Sep 08 01:06:32.263803 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 9/18] 10.222.0.42 () {64 vars in 1336 bytes} [Thu Sep 8 01:06:32 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:35.686063 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:35.687488 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Sep 08 01:06:35.687934 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 10/19] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:36.135491 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-38f5c4c5-2ed7-4e2b-852f-514612c16783 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:36.176854 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-38f5c4c5-2ed7-4e2b-852f-514612c16783 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.482072 Sep 08 01:06:36.177960 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 10/20] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 8 01:06:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:06:38.786693 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:38.787740 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-5abb0fa5-6a5b-444f-b1b8-abee36bc8cab admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 08 01:06:38.788173 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 11/21] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:39.191654 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-4856bac6-1385-46b1-877c-da4cfafe297e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "swap": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:39.211584 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-4856bac6-1385-46b1-877c-da4cfafe297e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417161 Sep 08 01:06:39.212081 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 11/22] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:39.224789 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-3a9b8a9c-a5a1-44e5-be33-abe1132cd2b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:39.251981 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-3a9b8a9c-a5a1-44e5-be33-abe1132cd2b5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030754 Sep 08 01:06:39.252820 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 12/23] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 8 01:06:39 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:41.848557 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-4856bac6-1385-46b1-877c-da4cfafe297e admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:41.849572 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-4856bac6-1385-46b1-877c-da4cfafe297e admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 08 01:06:41.850241 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:42.252321 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-d8655385-8b98-4b35-aea5-aa99b0d22ed2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "vcpus": 1, "id": "2", "ram": 2048, "rxtx_factor": 1.0}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:42.275826 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-d8655385-8b98-4b35-aea5-aa99b0d22ed2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419147 Sep 08 01:06:42.276440 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 13/25] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:42.290519 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-0f5cfeff-33a0-48d7-86e3-8f818dce1a52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:42.316984 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-0f5cfeff-33a0-48d7-86e3-8f818dce1a52 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030638 Sep 08 01:06:42.317571 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 13/26] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 8 01:06:42 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:44.992961 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-d8655385-8b98-4b35-aea5-aa99b0d22ed2 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:44.993980 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-d8655385-8b98-4b35-aea5-aa99b0d22ed2 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 08 01:06:44.994567 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 14/27] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:45.442447 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-9cf1eb51-dacc-4f75-a81c-7dc9f1ee5fbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "name": "m1.medium", "ram": 4096}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:45.466435 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-9cf1eb51-dacc-4f75-a81c-7dc9f1ee5fbb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.465011 Sep 08 01:06:45.467339 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 14/28] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:45 2022] POST /compute/v2.1/flavors => generated 406 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:45.480412 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-94f44e0e-c65d-47d9-b5ff-aebb5514afa2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:45.486123 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:45.510646 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-94f44e0e-c65d-47d9-b5ff-aebb5514afa2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033907 Sep 08 01:06:45.511343 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 15/29] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 8 01:06:45 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:06:48.137370 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-9cf1eb51-dacc-4f75-a81c-7dc9f1ee5fbb admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:48.139070 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-9cf1eb51-dacc-4f75-a81c-7dc9f1ee5fbb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002389 Sep 08 01:06:48.144451 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:48 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:48.586470 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-265ef4fc-3f20-43b3-8ed9-774b9beae5f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "disk": 80, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:48.610425 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-265ef4fc-3f20-43b3-8ed9-774b9beae5f3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463851 Sep 08 01:06:48.611366 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 16/31] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:48.623419 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-e1ebb227-2931-4499-ab28-e97015a8592f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:48.649775 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-e1ebb227-2931-4499-ab28-e97015a8592f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030041 Sep 08 01:06:48.650458 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 16/32] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 8 01:06:48 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:06:51.296888 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-265ef4fc-3f20-43b3-8ed9-774b9beae5f3 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:06:51.298519 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-265ef4fc-3f20-43b3-8ed9-774b9beae5f3 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002276 Sep 08 01:06:51.298934 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:06:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:06:51.744985 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "disk": 160, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:51.755430 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:06:51.785188 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.480064 Sep 08 01:06:51.785913 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 17/34] 10.222.0.42 () {64 vars in 1283 bytes} [Thu Sep 8 01:06:51 2022] POST /compute/v2.1/flavors => generated 408 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:06:51.798528 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-2ab20e9e-fdb9-4163-872a-d5296ddec498 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:06:51.839463 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-2ab20e9e-fdb9-4163-872a-d5296ddec498 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045117 Sep 08 01:06:51.852544 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 18/35] 10.222.0.42 () {64 vars in 1333 bytes} [Thu Sep 8 01:06:51 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:07:09.336337 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:09.337353 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 08 01:07:09.337750 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 18/36] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:07:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:09.349184 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:07:09.725290 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-a5cf820f-dc7f-4b3c-b13e-e029f3f6e71a admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:09.744293 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-a5cf820f-dc7f-4b3c-b13e-e029f3f6e71a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399510 Sep 08 01:07:09.744830 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 19/37] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 8 01:07:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:07:11.055602 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:11.056642 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-8d96aa3c-656e-44a6-a79f-3ba427406b5f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 08 01:07:11.057034 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:11.582553 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-a74c4040-78ab-4fdf-885c-389b2f5def77 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:11.587819 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.wsgi [None req-a74c4040-78ab-4fdf-885c-389b2f5def77 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-a74c4040-78ab-4fdf-885c-389b2f5def77 admin admin] Request method failure captured: Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept: application/json Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept-Encoding: gzip, deflate Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Connection: keep-alive Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Content-Length: 0 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Host: 10.222.0.42 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-System-Scope: None Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: User-Agent: python-novaclient Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Auth-Token: gAAAAABjGUA-Qu0TQ7_HXKoFdOCPLqT461DLzM-yeTrtmxqj7GzN3zucAoT1bGMojPgtJYW1eaUcuqKsQB7zn5jv9ERu2zCbG8bGHIy5F5ioYY8CA4SuMdJamHloURq2878Z2uQ_qEgmwDOt-5rfSFpV4IgXnGmDVZhZ3EaVoU4gbstkiFN27lk Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Id: None Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Name: None Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Identity-Status: Confirmed Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Is-Admin-Project: True Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Id: default Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Name: Default Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Name: admin Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Role: member,reader,admin Sep 08 01:07:11.591084 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Roles: member,reader,admin Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant: admin Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Name: admin Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User: admin Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Id: default Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Name: Default Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Name: admin Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: method: > Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: exception: Flavor 42 could not be found. Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: action_args: {'id': '42'} Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:11.592985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:11.594074 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.595630 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-a74c4040-78ab-4fdf-885c-389b2f5def77 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:11.596931 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-a74c4040-78ab-4fdf-885c-389b2f5def77 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397923 Sep 08 01:07:11.596931 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 8 01:07:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:11.602604 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-bfacc7fd-49ce-492e-acd9-c83cf1a3067a admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:11.627183 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-bfacc7fd-49ce-492e-acd9-c83cf1a3067a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028144 Sep 08 01:07:11.627761 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 20/40] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:07:11.638940 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-8d73536c-0718-4f4e-9868-3db54d584e11 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:11.660864 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-8d73536c-0718-4f4e-9868-3db54d584e11 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026991 Sep 08 01:07:11.661415 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 21/41] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:07:11.672145 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-6693221e-0405-4c63-b86d-5edff43be832 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:11.677746 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.wsgi [None req-6693221e-0405-4c63-b86d-5edff43be832 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-6693221e-0405-4c63-b86d-5edff43be832 admin admin] Request method failure captured: Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept: application/json Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept-Encoding: gzip, deflate Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Connection: keep-alive Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Content-Length: 0 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Host: 10.222.0.42 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-System-Scope: None Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: User-Agent: python-novaclient Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Auth-Token: gAAAAABjGUA-Qu0TQ7_HXKoFdOCPLqT461DLzM-yeTrtmxqj7GzN3zucAoT1bGMojPgtJYW1eaUcuqKsQB7zn5jv9ERu2zCbG8bGHIy5F5ioYY8CA4SuMdJamHloURq2878Z2uQ_qEgmwDOt-5rfSFpV4IgXnGmDVZhZ3EaVoU4gbstkiFN27lk Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Id: None Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Name: None Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Identity-Status: Confirmed Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Is-Admin-Project: True Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Id: default Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Name: Default Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Name: admin Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Role: member,reader,admin Sep 08 01:07:11.681078 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Roles: member,reader,admin Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant: admin Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Name: admin Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User: admin Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Id: default Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Name: Default Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Name: admin Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: method: > Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: exception: Flavor 42 could not be found. Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: action_args: {'id': '42'} Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:11.682652 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:11.683531 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:11.684828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-6693221e-0405-4c63-b86d-5edff43be832 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:11.686740 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-6693221e-0405-4c63-b86d-5edff43be832 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015147 Sep 08 01:07:11.686740 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 8 01:07:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 08 01:07:12.909623 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-8d73536c-0718-4f4e-9868-3db54d584e11 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:12.910641 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-8d73536c-0718-4f4e-9868-3db54d584e11 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 08 01:07:12.911041 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:07:13.439646 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-e6eea311-c917-41be-bf8d-ceb19c2a65ed admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:13.444657 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.wsgi [None req-e6eea311-c917-41be-bf8d-ceb19c2a65ed admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-e6eea311-c917-41be-bf8d-ceb19c2a65ed admin admin] Request method failure captured: Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept: application/json Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept-Encoding: gzip, deflate Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Connection: keep-alive Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Content-Length: 0 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Host: 10.222.0.42 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-System-Scope: None Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: User-Agent: python-novaclient Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Auth-Token: gAAAAABjGUBAdRzzE1xHj-cUluF0BTfa_9HAG32Bzfo0sPnJ5iTVwXDzTpaSJIWQyIcyjOD5AKCLmPghP36LXCE2zWY2Q6RIHgbWAf0YYEgwl8FIo-6CefUfmtlZNZz8T0WRPjcFrH6nhjyNcQlNPQO9WPKeNJFSzOzTCLMaK3uSvyODwf-F48c Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Id: None Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Name: None Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Identity-Status: Confirmed Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Is-Admin-Project: True Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Id: default Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Name: Default Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Name: admin Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Role: member,reader,admin Sep 08 01:07:13.446158 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Roles: member,reader,admin Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant: admin Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Name: admin Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User: admin Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Id: default Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Name: Default Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Name: admin Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: method: > Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: exception: Flavor 84 could not be found. Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: action_args: {'id': '84'} Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:13.447668 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:13.448673 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.450134 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-e6eea311-c917-41be-bf8d-ceb19c2a65ed admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:13.452232 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-e6eea311-c917-41be-bf8d-ceb19c2a65ed admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.399240 Sep 08 01:07:13.452232 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 8 01:07:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:13.458238 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-d6e4a53d-0736-4a47-8a87-637e776b2c71 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:13.474140 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-d6e4a53d-0736-4a47-8a87-637e776b2c71 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019522 Sep 08 01:07:13.474688 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:07:13.484270 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-d4e54170-1c99-4aa8-9025-d9bbb5e399d0 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:13.503730 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-d4e54170-1c99-4aa8-9025-d9bbb5e399d0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.023168 Sep 08 01:07:13.504295 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:07:13.514488 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-c1dfb54e-c893-4e4c-a307-62dc4d887c4a admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:13.519461 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.wsgi [None req-c1dfb54e-c893-4e4c-a307-62dc4d887c4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-c1dfb54e-c893-4e4c-a307-62dc4d887c4a admin admin] Request method failure captured: Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept: application/json Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept-Encoding: gzip, deflate Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Connection: keep-alive Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Content-Length: 0 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Host: 10.222.0.42 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-System-Scope: None Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: User-Agent: python-novaclient Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Auth-Token: gAAAAABjGUBAdRzzE1xHj-cUluF0BTfa_9HAG32Bzfo0sPnJ5iTVwXDzTpaSJIWQyIcyjOD5AKCLmPghP36LXCE2zWY2Q6RIHgbWAf0YYEgwl8FIo-6CefUfmtlZNZz8T0WRPjcFrH6nhjyNcQlNPQO9WPKeNJFSzOzTCLMaK3uSvyODwf-F48c Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Id: None Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Name: None Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Identity-Status: Confirmed Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Is-Admin-Project: True Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Id: default Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Name: Default Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Name: admin Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Role: member,reader,admin Sep 08 01:07:13.521311 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Roles: member,reader,admin Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant: admin Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Name: admin Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User: admin Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Id: default Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Name: Default Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Name: admin Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: method: > Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: exception: Flavor 84 could not be found. Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: action_args: {'id': '84'} Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:13.522913 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:13.523885 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:13.525037 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-c1dfb54e-c893-4e4c-a307-62dc4d887c4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:13.526096 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-c1dfb54e-c893-4e4c-a307-62dc4d887c4a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012779 Sep 08 01:07:13.526096 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 24/47] 10.222.0.42 () {60 vars in 1190 bytes} [Thu Sep 8 01:07:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:14.744147 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-d4e54170-1c99-4aa8-9025-d9bbb5e399d0 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:14.745181 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-d4e54170-1c99-4aa8-9025-d9bbb5e399d0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 08 01:07:14.745585 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 24/48] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:15.271228 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-194257d7-6da8-4d04-b08e-5207d8c703d9 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:15.277124 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.wsgi [None req-194257d7-6da8-4d04-b08e-5207d8c703d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-194257d7-6da8-4d04-b08e-5207d8c703d9 admin admin] Request method failure captured: Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept: application/json Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Accept-Encoding: gzip, deflate Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Connection: keep-alive Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Content-Length: 0 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Host: 10.222.0.42 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Openstack-System-Scope: None Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: User-Agent: python-novaclient Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Auth-Token: gAAAAABjGUBCvG2og4WhJJuZ9VaQY1kXS7yuf0XCJJBcxpf0TTZvg3b6Y4J3qNBzo2A0QxpBbShMSY6s1lHNZnIB2rRuSSe-F1-sP_baBgXDpTIj1rZzobMlMMTTQ1oAJATFSAO1XLUMKQCDlzkK8AxTG91qyhKj8WxwUgrDnVcqyTRP3UhCRsk Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Id: None Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Domain-Name: None Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Identity-Status: Confirmed Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Is-Admin-Project: True Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Id: default Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Domain-Name: Default Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Project-Name: admin Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Role: member,reader,admin Sep 08 01:07:15.279370 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Roles: member,reader,admin Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant: admin Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-Tenant-Name: admin Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User: admin Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Id: default Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Domain-Name: Default Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: X-User-Name: admin Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: method: > Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: exception: Flavor 451 could not be found. Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: action_args: {'id': '451'} Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:15.280985 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:15.281889 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.283008 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-194257d7-6da8-4d04-b08e-5207d8c703d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:15.284340 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-194257d7-6da8-4d04-b08e-5207d8c703d9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398149 Sep 08 01:07:15.284340 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 25/49] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:07:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:15.290645 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-0925a352-aefe-46b1-a153-6f2e42f1feb5 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:15.305669 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-0925a352-aefe-46b1-a153-6f2e42f1feb5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018617 Sep 08 01:07:15.306202 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 25/50] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:07:15.315632 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:15.331088 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019059 Sep 08 01:07:15.331619 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 26/51] 10.222.0.42 () {60 vars in 1210 bytes} [Thu Sep 8 01:07:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:07:15.340695 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-b4663c98-ac4d-425e-9400-6ecc10885d06 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:15.346321 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.wsgi [None req-b4663c98-ac4d-425e-9400-6ecc10885d06 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-b4663c98-ac4d-425e-9400-6ecc10885d06 admin admin] Request method failure captured: Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept: application/json Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Accept-Encoding: gzip, deflate Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Connection: keep-alive Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Content-Length: 0 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Host: 10.222.0.42 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-Api-Version: compute 2.92 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Openstack-System-Scope: None Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: User-Agent: python-novaclient Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Auth-Token: gAAAAABjGUBCvG2og4WhJJuZ9VaQY1kXS7yuf0XCJJBcxpf0TTZvg3b6Y4J3qNBzo2A0QxpBbShMSY6s1lHNZnIB2rRuSSe-F1-sP_baBgXDpTIj1rZzobMlMMTTQ1oAJATFSAO1XLUMKQCDlzkK8AxTG91qyhKj8WxwUgrDnVcqyTRP3UhCRsk Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Id: None Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Domain-Name: None Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Identity-Status: Confirmed Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Is-Admin-Project: True Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Id: default Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Domain-Name: Default Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Project-Name: admin Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Role: member,reader,admin Sep 08 01:07:15.347821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Roles: member,reader,admin Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fc3cae79b39a4ab893f53897bb099478"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fc3cae79b39a4ab893f53897bb099478", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fc3cae79b39a4ab893f53897bb099478"}]}] Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant: admin Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Id: fc3cae79b39a4ab893f53897bb099478 Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-Tenant-Name: admin Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User: admin Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Id: default Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Domain-Name: Default Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Id: 51f97eb5e7894117a81b5bd04a11488e Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: X-User-Name: admin Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: method: > Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: exception: Flavor 451 could not be found. Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: action_args: {'id': '451'} Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:07:15.349208 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:15.350011 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: ERROR nova.api.openstack.wsgi Sep 08 01:07:15.351061 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-b4663c98-ac4d-425e-9400-6ecc10885d06 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:07:15.352079 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-b4663c98-ac4d-425e-9400-6ecc10885d06 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012092 Sep 08 01:07:15.352079 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 26/52] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:07:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 01:07:16.574596 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:16.576314 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Sep 08 01:07:16.576712 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:17.104517 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-d9b3dec4-1b9a-4598-811f-47f9d5f61c02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:07:17.123649 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-d9b3dec4-1b9a-4598-811f-47f9d5f61c02 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.408933 Sep 08 01:07:17.124211 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 27/54] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 8 01:07:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:07:18.341923 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:18.342965 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Sep 08 01:07:18.343391 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:18.868484 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-d77f5711-0af5-4919-84cf-11d542928625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:07:18.886900 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-d77f5711-0af5-4919-84cf-11d542928625 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.405165 Sep 08 01:07:18.887428 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 28/56] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 8 01:07:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:07:20.103375 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:20.104442 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Sep 08 01:07:20.104846 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:20.635535 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-17e73ec2-3a4e-46e4-9b2e-350f127a0d4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:07:20.660226 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-17e73ec2-3a4e-46e4-9b2e-350f127a0d4b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.412799 Sep 08 01:07:20.660777 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 29/58] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 8 01:07:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:07:21.993000 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:21.994011 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 08 01:07:21.994410 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 30/59] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:22.521105 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-035b0e73-baa4-4f70-a316-5f41417434a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:07:22.539925 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-035b0e73-baa4-4f70-a316-5f41417434a2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.406270 Sep 08 01:07:22.540537 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 30/60] 10.222.0.42 () {64 vars in 1235 bytes} [Thu Sep 8 01:07:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:07:23.763711 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:23.764765 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Sep 08 01:07:23.765189 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 31/61] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:07:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:07:24.281055 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-a8b9c46a-3ef3-4b37-a7ab-d0a312d1ad54 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:07:24.301476 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-a8b9c46a-3ef3-4b37-a7ab-d0a312d1ad54 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402171 Sep 08 01:07:24.302009 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 31/62] 10.222.0.42 () {60 vars in 1202 bytes} [Thu Sep 8 01:07:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:08:21.305562 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.306571 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-61b6ccf8-b527-4449-8396-228aa19444aa admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 08 01:08:21.307152 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 32/63] 10.222.0.42 () {54 vars in 931 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:08:21.318478 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:21.734198 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-52722257-5e07-42c7-b5c9-e3f9f3e137d3 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.755737 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-52722257-5e07-42c7-b5c9-e3f9f3e137d3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.441696 Sep 08 01:08:21.756315 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 32/64] 10.222.0.42 () {60 vars in 1292 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:08:21.778047 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_api:SELECT=14 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:08:21.781826 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-62cd6ad7-dfdd-4581-a916-9f2efb2944df admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.789316 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-62cd6ad7-dfdd-4581-a916-9f2efb2944df admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012762 Sep 08 01:08:21.789829 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:08:21.801874 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-4ab0befa-d0c3-469e-8644-b2da51d4515f admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.809844 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-4ab0befa-d0c3-469e-8644-b2da51d4515f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011594 Sep 08 01:08:21.810368 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 33/66] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:08:21.821696 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.829925 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011743 Sep 08 01:08:21.830387 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 34/67] 10.222.0.42 () {60 vars in 1286 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:08:21.841753 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-e9caf3a8-0c0e-432e-add3-cd6cd42b3da0 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:08:21.849102 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-e9caf3a8-0c0e-432e-add3-cd6cd42b3da0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011146 Sep 08 01:08:21.849619 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 34/68] 10.222.0.42 () {60 vars in 1283 bytes} [Thu Sep 8 01:08:21 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:11:20.300034 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:20.301075 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Sep 08 01:11:20.301470 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:11:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:11:20.442965 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_api:SELECT=6 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:20.602079 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:20.606791 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:20.607269 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:20.607699 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:20.608441 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:20.608887 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:20.609365 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:20.641209 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-7f9a4729-201e-45bf-8067-e3afab0647c4 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.199722 Sep 08 01:11:20.641771 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 35/70] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:11:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:11:21.730727 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:21.731761 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 08 01:11:21.732183 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:11:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:11:21.922028 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:21.925433 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:21.925904 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:21.926328 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:21.927565 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:21.928001 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:21.928461 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:21.947439 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-5f5b967f-bc40-45e4-82c7-caa2e937dd4d admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075276 Sep 08 01:11:21.947969 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 36/72] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:11:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:11:33.450696 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:33.451710 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 08 01:11:33.452110 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:11:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:11:33.595064 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_cell0:SELECT=4 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:33.595799 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_cell1:SELECT=4 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:33.596490 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG dbcounter [-] [105705] Writing DB stats nova_api:SELECT=8 {{(pid=105705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:11:33.645934 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:33.649348 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:33.649821 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:33.650246 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:33.650962 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:33.651409 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:33.651825 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:33.677837 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-8bb65cac-f8ef-4586-a9d0-b48dbdbe77a2 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.087215 Sep 08 01:11:33.678319 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 37/74] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:11:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:11:34.764486 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG nova.api.openstack.wsgi [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] Calling method '>' {{(pid=105706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:34.765503 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: INFO nova.api.openstack.requestlog [None req-73666e7e-4af4-48ed-b8a1-7c891c4d1591 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 08 01:11:34.765902 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: [pid: 105706|app: 0|req: 38/75] 10.222.0.42 () {56 vars in 1074 bytes} [Thu Sep 8 01:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:11:34.956857 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG nova.api.openstack.wsgi [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Calling method '>' {{(pid=105705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:11:34.960314 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:34.960828 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:34.961260 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:34.961976 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:11:34.962425 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:11:34.962846 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: DEBUG oslo_concurrency.lockutils [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:11:34.985047 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: INFO nova.api.openstack.requestlog [None req-ffedadf3-17a0-4ad1-87f4-bc8c6efd8844 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079998 Sep 08 01:11:34.985603 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: [pid: 105705|app: 0|req: 38/76] 10.222.0.42 () {60 vars in 1193 bytes} [Thu Sep 8 01:11:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:12:32.780820 dv-cinder-847733-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 01:12:32.781378 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: Thu Sep 8 01:12:32 2022 - graceful shutdown triggered... Sep 08 01:12:32.781801 dv-cinder-847733-3-iscsi devstack@n-api.service[105705]: Gracefully killing worker 1 (pid: 105705)... Sep 08 01:12:32.788414 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: Gracefully killing worker 2 (pid: 105706)... Sep 08 01:12:32.918839 dv-cinder-847733-3-iscsi devstack@n-api.service[105706]: DEBUG dbcounter [-] [105706] Writing DB stats nova_api:SELECT=4 {{(pid=105706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:12:33.782286 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: worker 1 buried after 1 seconds Sep 08 01:12:33.782786 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: worker 2 buried after 1 seconds Sep 08 01:12:33.782786 dv-cinder-847733-3-iscsi devstack@n-api.service[105703]: goodbye to uWSGI. Sep 08 01:12:33.783900 dv-cinder-847733-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 08 01:12:33.784479 dv-cinder-847733-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 01:12:33.787292 dv-cinder-847733-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 01:12:33.798118 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 01:12:33 2022] *** Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: nodename: dv-cinder-847733-3-iscsi Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: machine: x86_64 Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: clock source: unix Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: pcre jit disabled Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: detected number of CPU cores: 4 Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: current working directory: / Sep 08 01:12:33.799957 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: detected binary path: /usr/bin/uwsgi-core Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: your processes number limit is 47680 Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: your memory page size is 4096 bytes Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: detected max file descriptor number: 2048 Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: lock engine: pthread robust mutexes Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: thunder lock: enabled Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 01:12:33.801511 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 01:12:33.840713 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: Python main interpreter initialized at 0x55ceeaf319c0 Sep 08 01:12:33.840713 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: python threads support enabled Sep 08 01:12:33.840713 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: your server socket listen backlog is limited to 100 connections Sep 08 01:12:33.840713 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: your mercy for graceful operations on workers is 90 seconds Sep 08 01:12:33.841104 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 01:12:33.841191 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: *** Operational MODE: preforking *** Sep 08 01:12:33.841396 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: *** uWSGI is running in multiple interpreter mode *** Sep 08 01:12:33.841396 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: spawned uWSGI master process (pid: 120704) Sep 08 01:12:33.841587 dv-cinder-847733-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 08 01:12:33.843023 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: spawned uWSGI worker 1 (pid: 120715, cores: 1) Sep 08 01:12:33.843023 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: spawned uWSGI worker 2 (pid: 120716, cores: 1) Sep 08 01:12:33.843023 dv-cinder-847733-3-iscsi devstack@n-api.service[120704]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 01:12:34.519948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 01:12:34.521905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 01:12:35.707818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:12:35.707818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: from cryptography.utils import int_from_bytes Sep 08 01:12:35.708484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:12:35.708484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: from cryptography.utils import int_from_bytes Sep 08 01:12:35.710390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:12:35.710390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: from cryptography.utils import int_from_bytes Sep 08 01:12:35.710813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 01:12:35.710813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: from cryptography.utils import int_from_bytes Sep 08 01:12:38.143220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 01:12:38.144947 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 01:12:38.144947 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 01:12:38.145251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 01:12:38.145391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 01:12:38.145839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.146176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.146513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.146857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.147188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.147505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.147848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.148224 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.148523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.148792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.149116 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.149620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-3-iscsi {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.149956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.150276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.150595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.150928 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.151259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.151577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.151908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.152455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.153883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.153883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.153883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.154169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.154501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.154825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.155147 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.155464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.155807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.156121 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.156589 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-3-iscsi {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.156920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.157246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.157572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.158005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.158319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.158638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.158968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.159332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.159734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.159734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.159734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.159734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.161327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.161425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.161720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.162049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.162365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.162676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.163001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.163285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.163577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.163907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.164263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.164599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.164860 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.165118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.165446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.165776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.166095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.166412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.166726 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.167041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.167355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.167671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.167987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.168330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.168659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.168984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.169319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.169634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.169961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.170383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.170638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.170953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.171304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.171629 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.171945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.172303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.172642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.172965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.173282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.173597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.173930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.174279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.174596 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.174854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.175268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.175586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.175918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.176259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.176576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.176891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.177206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.177518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.177835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.178151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.178462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.178972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.179293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.179608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.179924 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.180266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.180584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.180922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.181246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.181566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.181882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.182196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.182511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.182849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.183168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.183483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.183815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.184172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.184471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.184802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.185121 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.185434 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.185765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.186076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.186390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.186719 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.187034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.187352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.187659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.187972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.188331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.188645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.188956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.189270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.189571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.189902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.190238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.191092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.191415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.191726 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.192054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.192434 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.192776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.193130 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.193458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.193812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.194153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.194487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.194794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.195114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.195457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.195769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.196087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.196454 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.196783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.197112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.197456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.197784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.198107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.198436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.198758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.199086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.199435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.199757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.200076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.200461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.200821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.201144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.201477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.201815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.202140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.202514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.202786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.203149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.203558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.203796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.204151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.204495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.204820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.205132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.205451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.205788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.206097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.206979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.207381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.207659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.207993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.208343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.208667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.208996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.209317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.209640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.209958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.210269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.210579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.210891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.211209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.211520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.211849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.212281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.212603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.212939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.213258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.213577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.213897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.214214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.214533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.215580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.215580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.215580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.216065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.216065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.216410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.216781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.217025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.217449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.217807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.218050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.218305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.219222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.219222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.219222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.219776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.219928 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.220226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.220506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.221009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.221175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.221466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.222015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.222181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.222419 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.222782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.223049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.223359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.223675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.224052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.224373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.224640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.225765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.225765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.225765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.226207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.226207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.226502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.226713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 01:12:38.227405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.227581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 01:12:38.227744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.227744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.228034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 01:12:38.228217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.228400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 01:12:38.228639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.228798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 01:12:38.228951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.229107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.229261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.229403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.229552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.229722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.229867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.230014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.230188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.230457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.230617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.230769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.230913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.231056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.231206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.231356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.231508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.231652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.231817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.231961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.232115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.232293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.232451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.232594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-3-iscsi {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.232793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.232948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.233099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.233249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.233406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.233556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.233715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.233859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.234009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.234266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.234898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.235087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.235333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.235493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.235637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.235637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.236175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.236175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.236504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.236504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.236910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.237066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.237211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.237716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.237886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.238041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.238206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.238350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.238493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.238661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.238916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.239065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.239228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.239395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.239547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.239698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.239698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.239984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.240127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.240127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.240568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-3-iscsi {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.240720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.240869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.241025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.241181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.241332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.241481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.241623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.241772 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.241923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.242079 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.242222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.242365 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.242506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.242678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.242872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.243054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.243208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.243357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.243508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.243658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.243821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.243965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.244114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.244295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.244514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.244664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.244824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.245002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.245161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.245331 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.245547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.245696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.245853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.246159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.246311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.246461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.246605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.246762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.246762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.247043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.247205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.247357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.247508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.247665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.247816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.247958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.248110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.248294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.248439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.248597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.248748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.248925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.249088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.249231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.249386 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.249537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.249689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.249840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.249993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.250142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.250305 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.250460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.250609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.250753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.250914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.251064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.251216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.251359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.251501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.251642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.251784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.251936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.252088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.252396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.252549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.252692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.252834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.253831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.254183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.254337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.254508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.254730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.254880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.255039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.255183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.255326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.255475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.255703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.255861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.256018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.256351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.256503 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.256646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.256788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.256788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.257082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.257228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.257370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.257513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.257655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.257805 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.257948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.258103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.258311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.258471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.258622 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.258780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.258923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.259066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.259214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.259357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.259761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.259761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.260069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.260237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.260401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.260544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.260687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.260842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.260997 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.261140 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.261290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.261290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.261572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.261572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.261850 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.261991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.262142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.262142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.262431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.262431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.262708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.262851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.263003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.263202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.263346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.263497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.263641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.263798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.263942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.264091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.264298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.264443 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.264593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.264762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.264980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.265127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.265277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.265428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.265582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.265751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.265751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.266126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.267063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.267244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.267402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.267548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.267691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.267841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.267998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.268170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.268321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.268463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.268606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.268815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.269474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.269635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.269798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.269948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.269948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.270313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.270467 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.270616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.270765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.270924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.271074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.271237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.271386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.271534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.271695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.271853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.272009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.272193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.272359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.272510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.272659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.272814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.272964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.273171 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.273334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.273490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.273640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.273807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.273977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.274134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.274322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.274481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.274639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.274795 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.274795 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.275189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.275352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.275502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.275658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.275807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.275997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.276269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.276441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.276592 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.276742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.276898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 01:12:38.277376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277525 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.277999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.278308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.278468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.278619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.278768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.278925 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279679 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.279993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.280272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.280433 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.280594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.280761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.280924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281539 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.281894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282371 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.282983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283139 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.283958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284321 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.284963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285830 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.285981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.286137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.286369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.286548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.286748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.286909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.287984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288642 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.288952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.289854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290467 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.290951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.291864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.292852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.293981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.294916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.295935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.296093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.296268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.296511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.296677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.296836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297161 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.297943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298116 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298790 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.298959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.299264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.299413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.299568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.299736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.299886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.300836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.300990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.301939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.302865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.303853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304199 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.304990 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.305950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.306194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.306355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.306522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.306754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.306918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.307068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.307230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.307535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.307696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.307853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308219 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.308869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.309828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310131 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.310894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311371 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311846 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.311996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.312977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.313133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.313290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.313447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.313645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.313886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314652 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.314963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.315119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.315268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.315424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.315657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.316932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317021 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317115 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.317853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318199 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.318924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319433 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.319960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320468 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.320916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321001 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321187 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.321987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322705 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322796 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322887 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.322980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323148 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323666 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.323911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.324894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.325830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.326995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327155 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327320 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.327931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.328961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.329111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.329416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.329516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.329727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.329826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330038 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330139 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.330997 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.331110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.331315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.331437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.331626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.331957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.332977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.333951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.334224 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.334455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.334561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.334781 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.334882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.335835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.336827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.337978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.338149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.338301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.338554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.338646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.338893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.339920 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.340915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341544 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.341851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.342986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.343998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.344291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.344408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.344630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.344743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.344929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.345958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.346942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.347986 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348092 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.348991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349405 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.349959 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.350927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351021 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.351945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.352270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.352434 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.352660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.352762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353055 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353475 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.353825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354454 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.354975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.355996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356328 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.356950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357781 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.357875 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358795 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.358987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.359910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.360942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.361977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.362190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.362292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.363836 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364498 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.364936 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.365884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366718 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.366820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.367958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368591 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.368937 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369664 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369775 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.369975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370605 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.370918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.371950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372594 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.372900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.373995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.374986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.375922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.376982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.377929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.378197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.379952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380115 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380454 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.380926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381242 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.381881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.382978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.383998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.384183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.384340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.384754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.384903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385073 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.385843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.386905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387755 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.387873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388397 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.388813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.389965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390705 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.390929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.391985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.392221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.392372 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.392549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.392687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.392865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.393922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.394190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.394284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.394589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.394682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.394910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.395963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396497 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396802 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.396915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.397913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398161 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.398760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399386 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.399942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.400949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.401979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.402952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403473 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403802 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.403895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.404870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.405838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.406862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407056 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.407749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.408960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.409078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.409303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.409401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.409678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.409802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.410955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.411984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.412953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413135 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413619 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.413971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.414957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.415049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.415268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.415362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.415514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 01:12:38.415666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.415973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.416301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.416609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.416953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.417258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.417589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.417900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.418227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.418546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.418862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.419178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.419500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.419817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.420150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.420469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.420779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.421096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.421415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.421734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.422262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.422591 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.422907 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.423220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.423533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.423849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.424182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.424497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.424810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.425658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.425974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.426308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.426630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.426957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.427293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.427608 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.427923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.428265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.428581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.428941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.429256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.429566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.429877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.430189 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.430503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.430817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.431127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.431441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.431754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.432069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.432418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.432734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.433049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.433377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.433729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.434031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.434344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.434657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.434974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.435493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.435810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.436175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.436501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.436824 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.437142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.437459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.437788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.438096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.438401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.438711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.439017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.439322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.439644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.439954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.440277 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.441250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.441767 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.442313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.442667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.442988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.443328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.443646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.443965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.444326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.444657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.444967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.445273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.445671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.445989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.446295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.446601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.446914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.447229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.447530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.447841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.448167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.448492 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.448805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.449112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.449506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.449823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.450129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.450433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.450738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.451045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.451358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.451665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.452064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.452403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.452718 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.453075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.453389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.453696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.454020 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.454328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.454634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.454951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.455262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.455588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.455974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.456698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.457063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.457386 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.457926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.458269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.458598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.458942 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.459278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.459588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.459897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.460227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.460559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.460874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.461190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.461503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.461815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.462545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.462545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.462740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.463018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.463326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.463637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.463946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.464278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.464592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.464899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.465215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.465555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.465875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.466194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.466507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.466829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.467141 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.467451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.467759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.468068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.468409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.468746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.469062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.469368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.469790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.470108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.470426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.470746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.471057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.471380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.471702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.472103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.472621 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.472940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.473273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.473614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.473944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.474269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.474576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.474880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.475186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.475497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.475816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.476202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.476452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.476756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.477064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.477367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.477671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.477975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.478087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Registered counter for database nova_api Sep 08 01:12:38.478281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.478589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.478895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.479196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.479498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.479798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.480099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.480426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.480734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.481036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.481340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.481641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.481944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.482246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.482578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.482913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.483232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.483554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.483866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.484207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.484520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.484842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.485163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.485478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.485788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.486119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.486429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.486742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.487054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.487365 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.488272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.488588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.488921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.489256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.489563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.489887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.490206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.490525 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.490842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.491152 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.491481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.491791 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.492102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.492435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.492745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.493055 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.493376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.493928 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.494051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.494345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.494611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.494938 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.495258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.495580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.495895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.496252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.496609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.496921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.497267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.497597 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.497912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.498227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.498529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 01:12:38.498776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120715) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 01:12:38.498958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.505974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.561619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Registered counter for database nova_api Sep 08 01:12:38.562669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.context [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),399af677-d3da-4cd3-8ba5-6488df620aa9(cell1) {{(pid=120716) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 01:12:38.567372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:12:38.567849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:12:38.569462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:12:38.570217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:12:38.570668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:12:38.572710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:12:38.574702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Registered counter for database nova_cell0 Sep 08 01:12:38.578918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Registered counter for database nova_cell1 Sep 08 01:12:38.582290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.586171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.587623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.589056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.594414 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.596490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.647017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.context [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),399af677-d3da-4cd3-8ba5-6488df620aa9(cell1) {{(pid=120715) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 01:12:38.650980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:12:38.651452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:12:38.653052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:12:38.653794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:12:38.654236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:12:38.656252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:12:38.658242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Registered counter for database nova_cell0 Sep 08 01:12:38.662904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Registered counter for database nova_cell1 Sep 08 01:12:38.670484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.672768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.679114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.680411 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.753934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO dbcounter [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Registered counter for database nova_cell0 Sep 08 01:12:38.761068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_db.sqlalchemy.engines [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.766003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writer thread running {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:38.837689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO dbcounter [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Registered counter for database nova_cell0 Sep 08 01:12:38.845733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_db.sqlalchemy.engines [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120715) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 01:12:38.850554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writer thread running {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 01:12:39.085224 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:12:39.093002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:12:39.175943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:12:39.183617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:12:39.447505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:12:39.453619 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: WARNING keystonemiddleware.auth_token [None req-27684655-37ff-4f68-b52b-2a0c354e8a1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:12:39.461070 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ceeaf319c0 pid: 120716 (default app) Sep 08 01:12:39.533558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 01:12:39.539615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: WARNING keystonemiddleware.auth_token [None req-7e2fe049-10ec-41e0-85b1-95ece8e13f1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 01:12:39.545078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ceeaf319c0 pid: 120715 (default app) Sep 08 01:13:29.713865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.715499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.719142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.723322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.817514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.818556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.819527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:29.820545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:31.880341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-305042195", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "networks": [{"uuid": "14d5ea00-9b9b-4bb2-a82d-33f6ae20dd0f"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:31.906643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e24f0aa7-f1d0-4c41-a610-89a3c41f6363 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: .version_select at 0x7fe9cab0d3a0>, body: {"keypair": {"name": "tempest-keypair-363302953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAmQbNsUlD7x2+5QhuazAc6JblaUHDAvr4DzbFCgdwYDKTGYxa6Go+ErHqIdloYij2P3qVro4JF+AvjenX/KcYUvAenXyeD7JWumHZwzC3t9Qfatlzs8s2BceQ4bk6gLw=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:32.093871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-e24f0aa7-f1d0-4c41-a610-89a3c41f6363 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:32.116375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-e24f0aa7-f1d0-4c41-a610-89a3c41f6363 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for user 9f2e208a67d4443eb00c75c60c54173f and project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:32.208465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e24f0aa7-f1d0-4c41-a610-89a3c41f6363 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 2.503981 Sep 08 01:13:32.216466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 1/1] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 8 01:13:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 2507 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 01:13:32.760911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] validate_networks() for [('14d5ea00-9b9b-4bb2-a82d-33f6ae20dd0f', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:13:35.117696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:13:35.119391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:13:35.120442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:13:35.121212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:13:35.121915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:13:35.189295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:35.190099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:35.209770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:35.211344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:35.212047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:35.212724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:35.291216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Getting quotas for project c1186c0555f345b6915c81b1f33b84bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:35.323669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Getting quotas for user 36fe14a406444624a34a73e2ad60a75c and project c1186c0555f345b6915c81b1f33b84bc. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:35.386878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:13:35.397004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:13:35.640884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8371eaf8-1002-4be9-a70f-2230e5725a33 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.832459 Sep 08 01:13:35.645339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 1/2] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:13:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 5842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:13:35.711511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-81fff397-a338-4ed1-8baa-c6945568d439 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:35.712256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-81fff397-a338-4ed1-8baa-c6945568d439 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:35.743678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1944498068", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:36.194739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-81fff397-a338-4ed1-8baa-c6945568d439 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:36.226872 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-81fff397-a338-4ed1-8baa-c6945568d439 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1214 microversion: 2.1 time: 0.572900 Sep 08 01:13:36.236004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:35 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1214 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:36.723378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-00437f7e-92f1-45ef-a471-26389df34642 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: .version_select at 0x7fe9ca10ae50>, body: {"keypair": {"name": "tempest-keypair-1137562005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuMx96P8XOVfs3uKuDEK7gnsYoH5PtaClsVpD2Fh8/UfXGGasNBiyvSHotQQhPvUThJFeSr6FTAOn9ujylXJ4kryVYEHthdmJCofF7qN0k4AKO6ohHoeToGmwV2Ozx7AA=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:36.779919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-00437f7e-92f1-45ef-a471-26389df34642 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for project 8c24dd087c274b6094aa720d81b11e98. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:36.789316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-00437f7e-92f1-45ef-a471-26389df34642 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for user 3246a8dea80d4d5b8c3fb50d5f1f31c0 and project 8c24dd087c274b6094aa720d81b11e98. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:36.879641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-00437f7e-92f1-45ef-a471-26389df34642 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.642206 Sep 08 01:13:36.891178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 3/4] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:13:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:13:37.033990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] validate_networks() for [('f1b21a81-0c0e-49e3-be8e-e6c5c961479f', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:13:37.251526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c8f23842-1825-4136-9d00-45bf3468b2c4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:37.252157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c8f23842-1825-4136-9d00-45bf3468b2c4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:37.445243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c8f23842-1825-4136-9d00-45bf3468b2c4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:37.455504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c8f23842-1825-4136-9d00-45bf3468b2c4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1214 microversion: 2.1 time: 0.209035 Sep 08 01:13:37.470239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 4/5] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:37 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:13:37.655452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-405799874", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcd3bfef-d162-43f3-b680-fb8fdd13ce91"}], "security_groups": [{"name": "tempest-securitygroup--95571242"}], "key_name": "tempest-keypair-363302953", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:37.886188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] validate_networks() for [('bcd3bfef-d162-43f3-b680-fb8fdd13ce91', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:13:38.625979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:13:38.627121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:13:38.627956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:13:38.628663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:13:38.629309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:13:38.644954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:38.645732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:38.646419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:38.647470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:38.648127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:38.649025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:38.689563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:38.695937 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for user 9f2e208a67d4443eb00c75c60c54173f and project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:38.714776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:13:38.717385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:13:38.826874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0cc53ee5-dc0a-477c-a05f-e2957f0c9390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.177404 Sep 08 01:13:38.827624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 5/6] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 8 01:13:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 01:13:38.838947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:38.839575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:38.856598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:38.857147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:38.857952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:38.858843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:38.859453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:38.860073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:39.383594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:39.412863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-924380ab-5d8a-4073-a158-c6d7aacced28 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1210 microversion: 2.1 time: 0.584110 Sep 08 01:13:39.420198 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 6/7] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:38 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1210 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:39.446869 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:13:39.447969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:13:39.448730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:13:39.449403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:13:39.450425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:13:39.475446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:39.478583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:39.495923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:39.497205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:39.499904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:39.506094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:39.510119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:39.513144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:39.600469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:39.610729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for user 20af4425b7434d2dab7baeacbb845387 and project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:39.641097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:13:39.650729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:39.661792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:39.664671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:39.666265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:13:39.669268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a2e07b9b-e483-4276-862f-e3f0e50160c3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1280 microversion: 2.20 time: 0.211143 Sep 08 01:13:39.677638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 7/8] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:39 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:39.898205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cb40e6bf-f05f-4b28-8b5f-2c04259fbc1a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.352141 Sep 08 01:13:39.898940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 2/9] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:13:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 4354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 01:13:39.911971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9e4c7055-9847-4f9f-8aba-5eb6bd353798 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:39.912814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9e4c7055-9847-4f9f-8aba-5eb6bd353798 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:40.175633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9e4c7055-9847-4f9f-8aba-5eb6bd353798 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:40.196403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9e4c7055-9847-4f9f-8aba-5eb6bd353798 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1222 microversion: 2.1 time: 0.288113 Sep 08 01:13:40.206120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 8/10] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:39 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:40.447517 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:40.448353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:40.487211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1030876784", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:40.514050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:40.514558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:40.515003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:40.515728 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:40.533602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:40.533864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:40.692002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] validate_networks() for [('f1b21a81-0c0e-49e3-be8e-e6c5c961479f', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:13:41.001083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:41.041923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52ccb462-a0e9-4f92-bd6f-015b7ab726db tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1272 microversion: 2.1 time: 0.598002 Sep 08 01:13:41.043264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 3/11] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:40 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1272 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:41.069009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:41.069725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:41.246126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:41.273283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:41.275838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:41.277964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dac449c5-95dd-425d-9e80-8a6a4eb5ddef tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1280 microversion: 2.20 time: 0.233144 Sep 08 01:13:41.279180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 4/12] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:41 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1280 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:42.070919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:42.072428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:42.089185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.092162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.094157 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:42.096911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.098396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.100426 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:42.429418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:13:42.429956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:13:42.431620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:13:42.432883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:13:42.433792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:13:42.474626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.477835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.479486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:42.484596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.485523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.489678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:42.575583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:42.597948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for user 20af4425b7434d2dab7baeacbb845387 and project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:42.671663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:13:42.684388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:13:42.707348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:42.732345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-02c11751-a2de-465c-b014-b9dfca317834 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1272 microversion: 2.1 time: 0.663685 Sep 08 01:13:42.737574 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 5/13] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:42 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1272 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:42.779729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:42.784984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:42.812426 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.813194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.813886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:42.815739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:42.816251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:42.827573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:43.081604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6fac96bb-9f0c-43dd-b20f-779acc740c76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.593673 Sep 08 01:13:43.086129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 9/14] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:13:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:13:43.107818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fe7691cc-1359-4237-b0c0-fbe3a14b7088 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:43.113157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fe7691cc-1359-4237-b0c0-fbe3a14b7088 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:43.557846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:43.576836 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:43.580464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:43.582450 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-af4cbfd4-da49-4ae7-8035-d79beeb3426e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1332 microversion: 2.20 time: 0.834319 Sep 08 01:13:43.586588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 6/15] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:42 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1332 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:43.630649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fe7691cc-1359-4237-b0c0-fbe3a14b7088 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:43.639359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fe7691cc-1359-4237-b0c0-fbe3a14b7088 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1222 microversion: 2.1 time: 0.542677 Sep 08 01:13:43.654458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 10/16] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:43 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1222 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:43.768631 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:43.769250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:43.792049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:43.796409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:43.800417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:43.802335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:43.819001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:43.822557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:44.557493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:44.574813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50990297-4a59-45d4-842d-9c3f9227522a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.805052 Sep 08 01:13:44.575830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 7/17] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:43 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:44.621833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:44.622771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:44.633536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:44.636120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:44.636779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:44.640746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:44.644173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:44.645235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:44.671096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:44.671951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:44.686037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:44.691120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:44.691444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:44.696984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:44.697628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:44.701329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:45.260289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:45.284331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-200e5900-c8fb-4a29-b30a-2baa39a750c7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1226 microversion: 2.1 time: 0.614456 Sep 08 01:13:45.285160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 8/18] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:44 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1226 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:13:45.559873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:45.590052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:45.597651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:45.602359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f733e314-e390-4170-ab29-d2c227963066 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1350 microversion: 2.20 time: 0.986535 Sep 08 01:13:45.604167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:45.604817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:45.623831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 11/19] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:44 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1350 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:45.670475 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:45.691468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:45.694214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:45.701605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:45.708400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:45.711601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:46.194397 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2128475323", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5450ee5d-6e77-4a01-a611-6d543e3afa6d"}], "security_groups": [{"name": "tempest-securitygroup--275203578"}], "key_name": "tempest-keypair-1137562005", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:46.568967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] validate_networks() for [('5450ee5d-6e77-4a01-a611-6d543e3afa6d', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:13:46.773956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:46.786954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-88fad7a5-9cff-48e8-8466-bf1ccc49c851 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 1.190927 Sep 08 01:13:46.796033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 9/20] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:45 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:13:46.814118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:46.815044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:46.834634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:46.838907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:46.840671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:46.841607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:46.844806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:46.845693 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:47.661536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:47.677440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b7b8f4aa-876e-4a9e-8f1e-c6c45a6f3d40 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1282 microversion: 2.1 time: 0.877457 Sep 08 01:13:47.682085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 10/21] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:46 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1282 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:47.708904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:47.709857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:47.731097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:47.731605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:47.732047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:47.742872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:47.744780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:47.745299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:47.971087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:47.988626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:47.990684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:47.996119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-50bf10fb-fa81-4ded-9abd-25204d2ea9e9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1338 microversion: 2.20 time: 0.311219 Sep 08 01:13:47.996941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 11/22] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:47 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1338 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:48.010667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:48.011642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:48.029979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.030893 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.032700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:48.033806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.034503 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.035163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:48.480912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:13:48.481490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:13:48.482094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:13:48.482665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:13:48.483325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:13:48.507662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.512651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.513291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:48.514353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.516731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.520750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:48.596889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for project 8c24dd087c274b6094aa720d81b11e98. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:13:48.614315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for user 3246a8dea80d4d5b8c3fb50d5f1f31c0 and project 8c24dd087c274b6094aa720d81b11e98. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:13:48.658263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:48.665366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:13:48.675186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:13:48.854220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d00a4da-6b3e-4770-a986-3754d23559bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.664752 Sep 08 01:13:48.866576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 12/23] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:13:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:13:48.879939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:48.889125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:48.911188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.912310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.915235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:48.916332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:48.918962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:48.921106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:49.566954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:49.652769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:49.676648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d039a6b4-6fd8-4885-a1e2-109ebcf8a48c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 1.672059 Sep 08 01:13:49.678413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:47 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:49.686608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f89c1103-2c24-4778-bbd8-841997ceb551 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:49.691687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f89c1103-2c24-4778-bbd8-841997ceb551 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:49.839021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:49.860919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c838a32c-88ff-486b-adf6-495ba103c546 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1280 microversion: 2.1 time: 0.989300 Sep 08 01:13:49.863476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:48 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1280 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:49.876949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:49.880634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:49.909106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:49.912571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:49.916701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:49.917837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:49.920803 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:49.921293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:50.084970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:50.102326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:50.103943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:50.112975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a0b524c-d02f-49a4-a7d0-584a66819710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1338 microversion: 2.20 time: 0.246688 Sep 08 01:13:50.113588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 14/26] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:49 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1338 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:50.162409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f89c1103-2c24-4778-bbd8-841997ceb551 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:50.190106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f89c1103-2c24-4778-bbd8-841997ceb551 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1238 microversion: 2.1 time: 0.509272 Sep 08 01:13:50.214751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:49 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1238 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:50.704583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:50.705777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:50.726831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:50.731189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:50.732002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:50.737971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:50.740920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:50.742066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:51.664097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f175e4b0-4032-4087-a688-77643611cbe2", "tag": "a3feceff-0ba1-4373-bf87-ec5f1d48bab3"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:51.691023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:51.693391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:51.694832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:51.744520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Creating event network-changed:a3feceff-0ba1-4373-bf87-ec5f1d48bab3 for instance f175e4b0-4032-4087-a688-77643611cbe2 on hv-cinder-84773 Sep 08 01:13:51.745253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 01:13:51.745819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1abb23f8-c55b-493b-b5e8-7e70604a430e req-f7a9b017-44c3-48e2-aa8b-7d62a44793be service nova] Acquired lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 01:13:51.747175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:51.747801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:51.749118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:51.750678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:51.751732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:51.752405 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:51.778989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.compute.rpcapi [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 01:13:51.782269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] Releasing lock "compute-rpcapi-router" {{(pid=120715) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 01:13:51.811811 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-187b9ce3-1ba2-44be-99fc-2aac1a14a335 None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.205819 Sep 08 01:13:51.814719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:13:51.845668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:51.849336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:51.868040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:51.869109 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:51.871158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:51.873200 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:51.876538 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:51.879185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:52.231832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:52.267691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-125d3c1b-5fab-4487-b809-e077fb46fe0d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1280 microversion: 2.1 time: 0.446152 Sep 08 01:13:52.268474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:51 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1280 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:52.278596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:52.279811 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:52.291713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:52.297112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:52.298510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:52.299896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:52.300515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:52.301420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:52.475154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:52.492644 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4c92e76b-2796-411d-b66c-e125461eea78 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 1.793807 Sep 08 01:13:52.497319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 14/30] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:50 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 1800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:52.523412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:52.523412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:52.542723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:52.543214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:52.543653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:52.544441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:52.553506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:52.555185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:52.818762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:52.829156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3292902d-2587-47c5-9366-085ce562ca0e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1296 microversion: 2.1 time: 0.325604 Sep 08 01:13:52.831291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 15/31] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:52 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1296 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:53.293195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:53.293766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:53.313746 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:53.314245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:53.317678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:53.319904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:53.323559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:53.324003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:54.017016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:54.036005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-36833777-68fc-488c-928e-7da83007f7da tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1280 microversion: 2.1 time: 0.745346 Sep 08 01:13:54.039362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:53 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1280 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:54.052841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:54.054519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:54.070070 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:54.072119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:54.073248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:54.076657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:54.077489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:54.080057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:54.087738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:54.120378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:54.129599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:54.134040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b2e6c243-8b78-4324-bc5d-23c1e6085d52 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 1.864134 Sep 08 01:13:54.152097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 17/33] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:52 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 1883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:54.181996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:54.182625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:54.206705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:54.215133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:54.216423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:54.226483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:54.229598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:54.233886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:54.800986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:54.816162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c2facd00-b421-470c-a573-edbe58165618 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1296 microversion: 2.1 time: 0.662008 Sep 08 01:13:54.816844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 18/34] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:54 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1296 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:55.115578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d582038-e2ec-4bbc-ad3e-2300a1351fee", "tag": "b6117acd-350d-4456-834b-c9a47241d546"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:55.126905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.127785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.128596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.155136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] Creating event network-changed:b6117acd-350d-4456-834b-c9a47241d546 for instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee on hv-cinder-84773 Sep 08 01:13:55.168852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9a4da004-29ea-4753-8b17-c667863e4c9d req-e54f2bc6-e154-40b3-863e-71be0e3a2f84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349647 Sep 08 01:13:55.169595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 19/35] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:13:55.190407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:55.191682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:55.194883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:55.202322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.202816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.203994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.205670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.210061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.210940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.216980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c8a9b385-1642-4692-906f-15367a143a07 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 1.176166 Sep 08 01:13:55.222342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 17/36] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:54 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:55.252353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:55.253737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:55.273463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.275019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.275611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.277230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.279856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.281704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.843638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:55.858040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:55.861452 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:55.869701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c992df35-37b5-410c-8c18-c3d533f53b21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.645810 Sep 08 01:13:55.885398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:55 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:55.899222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:55.900274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:55.908364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.909137 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.909828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:55.910812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:55.911486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:55.912123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.022103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:56.032527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e27fd1cf-0c66-4ae3-bcd8-d27c4d50e78e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.858577 Sep 08 01:13:56.046592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 20/38] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:55 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:56.092390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:56.094320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:56.106013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:56.106785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:56.107414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.122144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7583f139-8fcd-4564-b78d-176acc4ae983 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1296 microversion: 2.1 time: 0.228548 Sep 08 01:13:56.124275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 19/39] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:55 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1296 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:56.138916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] Creating event network-changed:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:13:56.145311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-77fc7ec9-59d9-4202-8fea-bcaeec88c94f req-d6870c6c-fdda-42d7-bdcc-a9765e5e3c4c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056869 Sep 08 01:13:56.150680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 21/40] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:13:56.252465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:56.254339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:56.263617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:56.264383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:56.265012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.266984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:56.268791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:56.270134 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.902415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:56.904288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:56.914563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:56.915708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:56.916398 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.918063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:56.918833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:56.919563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:56.928570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:56.938236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dc04aa2f-d74a-4ac6-82f4-e6e6f9407986 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.690916 Sep 08 01:13:56.959299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:56 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:13:57.083982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:57.086933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:57.111128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:57.111631 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:57.112253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:57.123400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:57.123939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:57.131416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:57.151269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:57.640817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:57.670438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-48aa93c6-39e6-4e72-9037-644031e70aa4 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.592865 Sep 08 01:13:57.671213 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:57 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:57.677828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:57.678598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:57.692561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:57.693108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:57.693599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:57.696277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:57.697273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:57.706085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:57.741415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:57.758596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:57.762240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:57.767418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e793f07a-9237-4940-adeb-6223a9259356 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.872093 Sep 08 01:13:57.773102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:56 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:13:57.966820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:57.967631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:57.989965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:57.994286 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:57.996125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.003703 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.004471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.008430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.008554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:58.025298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c71ce766-6a14-408e-93c8-88b42e8b40f4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.351515 Sep 08 01:13:58.042342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 22/44] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:57 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:58.181150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a982f8af-808c-4b79-bf51-ac72f1c60699", "tag": "5a30e87b-823e-4d82-a9ce-a31b03decd58"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:58.203342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.204001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.204636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.236270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Creating event network-changed:5a30e87b-823e-4d82-a9ce-a31b03decd58 for instance a982f8af-808c-4b79-bf51-ac72f1c60699 on hv-cinder-84773 Sep 08 01:13:58.237593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 01:13:58.238411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-fa07cebb-db88-49b9-bb9a-516e85b4cb03 req-97c86080-e598-4994-8b60-2b2c6f7dec6f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 01:13:58.240765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.241412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.241959 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.242858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.244453 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.245565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.259459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.compute.rpcapi [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 01:13:58.260305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] Releasing lock "compute-rpcapi-router" {{(pid=120716) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 01:13:58.283485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fdbe7e31-e837-460c-bd9a-2788d0cd13ed None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107419 Sep 08 01:13:58.284518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 23/45] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:13:58.560578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:58.572078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7c9daf2d-024a-4f84-885c-7b469daa772e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.609608 Sep 08 01:13:58.573931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 23/46] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:57 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:58.700033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:58.701931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:58.719777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.720331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.720729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.721431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.721913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.722377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.810435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:58.812970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:58.820474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=38 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:13:58.842401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.843045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.844231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:58.865630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:58.866146 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:58.866544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.029472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.039912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9d2195c5-adb3-4068-ace9-91b3c292a120 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.346747 Sep 08 01:13:59.048458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 24/47] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:58 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:59.060471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:59.063575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:59.087640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:59.088844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:59.089792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.091302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:59.092689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:59.095099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.220700 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.237261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.244478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.246726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52e607d7-4402-4fd3-a13e-4cb0a3a1c169 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.445637 Sep 08 01:13:59.248234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 24/48] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:13:58 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:13:59.326593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.339513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-04ed6cf5-f269-40d7-a850-740da628551d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.288832 Sep 08 01:13:59.340091 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 25/49] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:59 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:13:59.362324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bfe335-f009-4567-b8b1-b1f1fb648d59", "tag": "2b614f05-722c-4dc3-a2a4-9c0f19d70a6f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:13:59.376098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:59.377023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:59.377611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.396737 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] Creating event network-changed:2b614f05-722c-4dc3-a2a4-9c0f19d70a6f for instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 on hv-cinder-84773 Sep 08 01:13:59.399173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-8e300792-f112-4bbc-9645-792fe467f155 req-960f7052-fd10-4b5d-b865-38b9703986e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045322 Sep 08 01:13:59.399771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 25/50] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:13:59.597851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:13:59.598767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:13:59.604772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:59.605251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:59.605684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.606370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:13:59.606843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:13:59.607267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:13:59.763687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:13:59.776507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d15c31ea-9299-40a0-b328-ed298000f6d4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.182476 Sep 08 01:13:59.777395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:13:59 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:00.067018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:00.067018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:00.073058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.073550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.073979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.074677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.075342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.075916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.081679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=85 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:00.227130 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.236001 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4468c350-8f8a-4ae4-874b-1f4cfcd3423d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.174509 Sep 08 01:14:00.236646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 26/52] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:00 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:00.280346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:00.281788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:00.284026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=14 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:00.284709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:00.299871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.300381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.300951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.301527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.301979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.302397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.367507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:00.368461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:00.377037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.377752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.378209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.378867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.379636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.380395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.488283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.498100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.502882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.504498 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-19ccf675-a1be-4f31-acbe-894445b7f633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.229749 Sep 08 01:14:00.505210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 27/53] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:00 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:00.571861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.581057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d4bc0918-9dba-4941-9d72-eb5b9730e1ab tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.219008 Sep 08 01:14:00.581825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:00 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:00.800086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:00.800744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:00.809210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.809968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.813252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.814426 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:00.814887 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:00.816778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:00.975149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:00.982957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f1ae3fad-9e81-4162-aa3e-87eba2f78e91 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.187471 Sep 08 01:14:00.983706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 28/55] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:00 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:01.258886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:01.260295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:01.268018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.268625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.269063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.269964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.270289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.270783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.427577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:01.436175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-62256380-ab24-401e-bc46-89a9abf960ae tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.180943 Sep 08 01:14:01.437736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 28/56] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:01 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:01.533444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:01.534054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:01.539915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.540438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.540875 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.541560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.542016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.542604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.604601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:01.605360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:01.612050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.613043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.613648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.614513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:01.615108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:01.615709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:01.700524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:01.711745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:01.713999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:01.715477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4135f556-5f66-48ec-8ae4-0079161ee147 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.186431 Sep 08 01:14:01.716489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:01 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:01.776532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=10 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:01.935479 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:01.943936 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a1e1b2b-7c5e-43ce-8fc8-da240b2dcbe7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.343398 Sep 08 01:14:01.944714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 29/58] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:01 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:02.007677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:02.008750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:02.015376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.015886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.016373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.017084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.017539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.018041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.179236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:02.189301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d097e17c-b8f9-48ba-bbb4-0c63eabd222c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.185393 Sep 08 01:14:02.190531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:02 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:02.464498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:02.464498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:02.469720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.470417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.470858 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.471571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.472027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.472480 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.607192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:02.616974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-179e3581-6ec9-4ed0-90b8-6f325b6f2550 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.159499 Sep 08 01:14:02.624019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 30/60] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:02 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:02.740829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:02.741457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:02.747441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.747915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.748385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.749067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.749511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.751026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.887344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:02.896057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:02.897525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:02.898628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6256c6e7-8d72-47b7-aac5-5456ce964024 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.161709 Sep 08 01:14:02.899186 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:02 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:14:02.967433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:02.968039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:02.973956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.974445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.974881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:02.975571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:02.976025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:02.976492 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.111984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:03.120305 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d26d8fd0-4268-4439-86aa-40feb6387ef9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.157050 Sep 08 01:14:03.120874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 31/62] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:02 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:03.211813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:03.213008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:03.219815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.220611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.220956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.221650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.222252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.222670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.417745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:03.430796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-931be076-2d7e-4396-b05c-0ffb90e2b9ad tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.220268 Sep 08 01:14:03.430796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:03 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:03.641088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:03.641682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:03.647671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.648162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.648588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.649265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.649713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.650129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.793460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:03.801952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa820c4c-1720-42e4-a15a-05dcd3a61d24 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.164698 Sep 08 01:14:03.802533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 32/64] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:03 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:03.925837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:03.926941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:03.933344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.933845 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.934281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:03.935077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:03.935743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:03.936207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.112713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.121226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.122933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.124061 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4225cc7d-7036-4219-9ad7-49e08b24aa80 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.203584 Sep 08 01:14:04.136163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 33/65] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:03 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:04.143502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:04.144110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:04.150129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.150522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.150958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.151663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.152315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.152742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.310660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.322114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e0aa347e-9aa0-4db7-8eac-ffc56467073c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.182523 Sep 08 01:14:04.323050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:04 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:04.451935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:04.452591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:04.459191 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.459664 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.460092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.460831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.461273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.461699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.602346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.609912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-96bd1ea7-99c1-482c-9b0f-af86aa81a18f tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.162039 Sep 08 01:14:04.610481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 34/67] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:04 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:04.825609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:04.826444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:04.833080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.833564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.834011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.834712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:04.835239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:04.835670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:04.971241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:04.979069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e8b3e919-a162-4cdc-a1e7-11ba8df88ce7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.157966 Sep 08 01:14:04.979796 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 34/68] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:04 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:05.152874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:05.153765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:05.165126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.168350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.169025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.169875 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.171680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.172588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.334947 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:05.345347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:05.346124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:05.346741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:05.347398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:05.348967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-128ec629-e711-4593-ae67-c58500e204da tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.201112 Sep 08 01:14:05.349880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 35/69] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:05 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:05.371264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.371822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.372535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.373476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.374138 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.374612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.521862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:05.530536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52fc3302-52b9-49aa-93e8-fd0c3d17e6be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.188903 Sep 08 01:14:05.531254 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 35/70] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:05 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:05.645935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:05.646833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:05.653408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.654112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.654810 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.655703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:05.656251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:05.656871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:05.802671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:05.811300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1126519a-6029-4a32-b256-52a5686fe17a tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.173696 Sep 08 01:14:05.811976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 36/71] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:05 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:06.003535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:06.005124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:06.023756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.029158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.029713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.030664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.031817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.032392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.225650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:06.237357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5eed75c3-639b-4bb4-89e8-1359705495c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.238411 Sep 08 01:14:06.238147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 36/72] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:05 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:06.375491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:06.376102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:06.382685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.383411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.383985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.385160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.385610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.386071 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.561223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:06.563094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:06.572798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.573503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.574190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.575035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.575685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.576279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.764293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:06.775826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:06.778869 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:06.780080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-204b5fb7-e7ea-415d-a6af-5f37f220039a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.409161 Sep 08 01:14:06.786798 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 37/73] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:06 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:06.835132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:06.835739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:06.844611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.845189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.845617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.846347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:06.848971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:06.851154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:06.875752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:06.891556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:06.908944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4de12645-7163-4249-8c68-439beb5b2231 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.357855 Sep 08 01:14:06.909705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 37/74] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:06 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:07.261414 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:07.263584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:07.265264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:07.274355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.277119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.278217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:07.279935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f27b92b9-a811-42fd-a387-7cc261e6c168 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.448758 Sep 08 01:14:07.283687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 38/75] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:06 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:07.284359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.285044 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.285639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:07.635572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:07.664641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4912c701-c9f5-447e-a2ee-ad728b1946fb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.405730 Sep 08 01:14:07.665253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 38/76] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:07 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:07.818011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:07.819180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:07.831068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.831698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.832803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:07.833690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.834396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.836190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:07.943132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:07.943327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:07.952914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.953400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.957776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:07.959871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:07.960354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:07.963492 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:08.084179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:08.093127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:08.095463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:08.096634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7ae44f1f-3d41-4b8e-83bc-3a037de3d80f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.284894 Sep 08 01:14:08.111690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 39/77] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:07 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:08.299581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:08.310046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:08.310987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:08.319000 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:08.327106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-18279def-ab87-4108-861e-41530d80e75a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.390956 Sep 08 01:14:08.330039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:08.330523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:08.330976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 39/78] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:07 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:08.331412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:08.332348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:08.332801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:08.333372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:08.580030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:08.589131 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-62f719f2-893e-4669-83f8-8769df5c259d tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.283440 Sep 08 01:14:08.590086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 40/79] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:08 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:08.694218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:08.695097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:08.704055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:08.705133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:08.705728 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:08.706609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:08.707215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:08.707793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.052113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.061729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ecbf2c2-ee4d-4990-b5c0-d85da9d9b98a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.371328 Sep 08 01:14:09.062361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 41/80] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:08 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:09.124259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:09.126093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:09.132353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.133044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.133661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.135323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.135781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.136227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.201156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f175e4b0-4032-4087-a688-77643611cbe2", "name": "network-vif-plugged", "status": "completed", "tag": "a3feceff-0ba1-4373-bf87-ec5f1d48bab3"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:09.213384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.214145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.214779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.232343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] Creating event network-vif-plugged:a3feceff-0ba1-4373-bf87-ec5f1d48bab3 for instance f175e4b0-4032-4087-a688-77643611cbe2 on hv-cinder-84773 Sep 08 01:14:09.238061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-e4e132e9-e0bf-4217-b59f-8bc24744e13b req-87943be8-1ae6-45c7-9f19-174ec0dc2340 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.691566 Sep 08 01:14:09.243500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 40/81] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:14:09.352069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:09.353368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:09.370580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.376362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.377244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.379498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.380478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.386216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.390222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.402460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.404515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.406639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-346f14b3-4dea-443e-8756-9d269010d01c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.285464 Sep 08 01:14:09.407771 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 42/82] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:09 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:09.614445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:09.615187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:09.629597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.632053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.632607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.636344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:09.637098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:09.638460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:09.648799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.669359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-028f4620-41d4-4b96-995a-0dc159b28a10 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.319949 Sep 08 01:14:09.670207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 41/83] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:09 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:09.946194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:09.957220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b53d5faa-4643-422c-8c2f-68b85fd367fd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.346355 Sep 08 01:14:09.958310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 43/84] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:09 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:10.089279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:10.090746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:10.098823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.099650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.100342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.101428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.102093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.102778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.441255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:10.441894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:10.451385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.452117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.452872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.453917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.454682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.455296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.484267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:10.494662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-14d71dfc-7f54-4d4c-b048-93c575c00107 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.411566 Sep 08 01:14:10.496535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 42/85] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:10 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:10.696410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:10.697028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:10.706760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:10.708848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.709344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.709789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.710501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:10.710955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:10.711379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:10.720595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:10.722625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:10.724188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-86f76b4a-a583-42d9-9669-909b70e5633b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.287019 Sep 08 01:14:10.726880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 44/86] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:10 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:10.753436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:10.984654 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:10.984990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:10.993145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.002314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a3c1a158-95e9-41da-bbb2-644314e80b6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.308833 Sep 08 01:14:11.002919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 43/87] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:10 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:11.005074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.005758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.006344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.007246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.007897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.008551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.203822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.214284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-278092a0-3027-4076-a16f-8f58927e3fda tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.235147 Sep 08 01:14:11.215783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 45/88] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:10 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:11.524903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:11.526097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:11.542291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.544784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.547953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.549263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.549971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.551999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.755242 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:11.756709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:11.765806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.766275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.766738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.768995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:11.770303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:11.771169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:11.818608 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.826439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-943c4b79-3a22-4895-b3bf-eac0e40f24be tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.309137 Sep 08 01:14:11.827137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 44/89] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:11 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:11.946491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.958461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.961200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:11.963276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-74ac5e04-0940-411d-a28e-09a2d4f3cc20 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.211529 Sep 08 01:14:11.964929 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 46/90] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:11 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:12.026705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:12.027319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:12.034511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.035002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.035607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.036524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.037131 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.037712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.245397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:12.246092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:12.263212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.263943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.264405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.265724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.266243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.266701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.270707 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:12.284209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f22bef46-0eae-4b2d-a74e-5e0765d9f068 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.260948 Sep 08 01:14:12.288114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 45/91] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:12 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:12.492464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "name": "network-vif-plugged", "status": "completed", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:12.514222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.516692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.517684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.547873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] Creating event network-vif-plugged:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:14:12.560394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-fd097918-2d15-4794-ba0a-eda5af8cba7b req-4d639d83-0479-40c4-9743-7118cb164fe6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072438 Sep 08 01:14:12.564895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 46/92] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:12.571358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:12.581749 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-41e299ce-0c1d-49dd-b4e0-ac27c12e3dbf tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1314 microversion: 2.1 time: 0.340666 Sep 08 01:14:12.584657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 47/93] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:12 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:12.854512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:12.855758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:12.866976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.867873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.876071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.878229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:12.879123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:12.879569 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:12.991996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:12.993858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:13.012726 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.013595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.014287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.017287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.017943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.025924 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.163415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.172567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-47dc4723-03d8-464b-8ec0-6afd6e5ae8d2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.322562 Sep 08 01:14:13.180544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 47/94] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:12 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:13.240614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.250990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.252059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.253412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0e26df9c-badb-4f41-bc33-fca39cb1cf01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.265347 Sep 08 01:14:13.254092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 48/95] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:12 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:13.315000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:13.315973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:13.324297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.325673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.326489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.328278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.329359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.330374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.522494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.536364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-87342233-f8d4-4bcf-a32f-b0b75e181133 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.225304 Sep 08 01:14:13.536913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 48/96] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:13 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:13.607221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:13.607833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:13.613983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.614465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.614899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.615588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:13.616039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:13.616533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:13.762838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:13.772342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ad26b3f7-74e0-4885-a4f8-24383e33943e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1500 microversion: 2.1 time: 0.169187 Sep 08 01:14:13.772934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 49/97] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:13 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:14.196310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:14.196986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:14.204600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.206770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.207203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.209168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.209977 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.215520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.282087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:14.282704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:14.288639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.289295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.289961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.290837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.291318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.291831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.372960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:14.381806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-218a553a-1b87-4946-89a1-b8b695a6cc23 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.189363 Sep 08 01:14:14.382378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 49/98] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:14 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:14.434966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:14.444172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:14.445570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:14.446672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1050fae0-7a4f-4cc3-82a0-904b587d8fd2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.171582 Sep 08 01:14:14.447237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 50/99] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:14 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:14.562407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:14.563018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:14.569328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.569798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.570527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.571122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.571577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.571999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.603448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d582038-e2ec-4bbc-ad3e-2300a1351fee", "name": "network-vif-plugged", "status": "completed", "tag": "b6117acd-350d-4456-834b-c9a47241d546"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:14.627805 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:14.636960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:14.637502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:14.665057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] Creating event network-vif-plugged:b6117acd-350d-4456-834b-c9a47241d546 for instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee on hv-cinder-84773 Sep 08 01:14:14.674194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-6f5e9be9-21cf-4a61-a78f-dc1e16669345 req-53d5e204-9aa2-40b7-9662-80df23777087 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073993 Sep 08 01:14:14.675193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 51/100] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:14.745449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:14.754244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3932d2e4-c3e4-4e53-9fef-02d8b4203399 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.196179 Sep 08 01:14:14.754812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:14 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:15.407013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:15.407615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:15.413930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.414401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.414827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.415500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.415942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.416389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.472220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:15.472880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:15.478896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.479375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.479807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.480529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.480985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.481412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.548268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:15.556211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2bc2daf4-f1ae-4b0d-8304-253b536c2661 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.154099 Sep 08 01:14:15.556820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 52/102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:15 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:15.611216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:15.619755 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:15.621402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:15.622586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-55e41ac6-af14-4d06-9795-30483532a928 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.154892 Sep 08 01:14:15.623419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 51/103] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:15 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:14:15.777948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:15.778544 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:15.786030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.786589 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.787282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.787968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:15.788428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:15.788843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:15.927874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:15.935551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3f986db7-6c3b-4643-a700-85c98dde68a7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.161535 Sep 08 01:14:15.936063 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 53/104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:15 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:16.579616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:16.580314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:16.586679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.587151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.587578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.588281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.588968 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.589563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.647046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:16.647759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:16.653879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.654576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.655343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.656472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.657084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.657506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.759731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:16.773082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68b5dbfe-bb93-419b-a04e-287d2ed76abb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.197350 Sep 08 01:14:16.774321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 52/105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:16 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:16.786212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a982f8af-808c-4b79-bf51-ac72f1c60699", "name": "network-vif-plugged", "status": "completed", "tag": "5a30e87b-823e-4d82-a9ce-a31b03decd58"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:16.807689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.808189 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.808768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.828251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] Creating event network-vif-plugged:5a30e87b-823e-4d82-a9ce-a31b03decd58 for instance a982f8af-808c-4b79-bf51-ac72f1c60699 on hv-cinder-84773 Sep 08 01:14:16.833963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-cdba23c1-1310-4a0e-9fcc-868e81e35d25 req-ad22bd4f-0d00-4b2a-8565-8a2558b74dc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058361 Sep 08 01:14:16.834568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 53/106] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:16.879114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:16.892023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:16.893670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:16.894999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-14056bb5-b1bc-4a73-9979-d970b0a1f53c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1404 microversion: 2.20 time: 0.251820 Sep 08 01:14:16.895552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 54/107] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:16 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:14:16.959049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:16.959740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:16.966612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.967164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.967745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:16.968613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:16.969170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:16.969704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.129586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:17.139182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a0a52a7e-6f5f-485c-88ae-97aca525e716 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.184079 Sep 08 01:14:17.139856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 54/108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:16 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:17.452276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80c6fc2b-3172-4967-b369-b0ff3349147f"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:17.455143 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:17.461394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.462120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.462758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.463630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.464080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.464541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.533326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:17.798063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:17.798669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:17.804770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.805247 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.805675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.806371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.806820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.807240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.943105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:17.950966 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ad7af87-26c9-401c-869e-e9e1a1148c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.156811 Sep 08 01:14:17.951896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 55/109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:17 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:17.967617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:17.969008 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:17.975034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.975514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.975945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:17.976661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:17.977109 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:17.977561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.125912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:18.134726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:18.136201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:18.137362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1b874b59-198f-4685-8866-8e75e993d08d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1597 microversion: 2.20 time: 0.184156 Sep 08 01:14:18.138079 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 56/110] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:14:17 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1597 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:14:18.163084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:18.163690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:18.169596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:18.170069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:18.170497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.171182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:18.171627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:18.172049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.307553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:18.318845 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7fc303e1-38e4-4a2d-a972-2669a39e110c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.159497 Sep 08 01:14:18.319437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 57/111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:18 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:18.334596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:18.335103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:18.341179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:18.341668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:18.342101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.343680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:18.344768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:18.344768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.475595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5a5e7080-476d-4563-9d01-6f8da830bf42 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.155101 Sep 08 01:14:18.476489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 58/112] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 8 01:14:18 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:14:18.859391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bfe335-f009-4567-b8b1-b1f1fb648d59", "name": "network-vif-plugged", "status": "completed", "tag": "2b614f05-722c-4dc3-a2a4-9c0f19d70a6f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:18.868583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:18.881015 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:18.884815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:18.885427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:18.903751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] Creating event network-vif-plugged:2b614f05-722c-4dc3-a2a4-9c0f19d70a6f for instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 on hv-cinder-84773 Sep 08 01:14:18.911549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-4d7a4c9a-5b78-49bb-b4f7-13f463906802 req-42a4af07-e3b0-49e8-9952-99a876a7bf58 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055659 Sep 08 01:14:18.912408 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 59/113] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:14:18.996898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:19.002298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:19.021034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:19.021834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:19.022452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:19.026089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:19.026713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:19.027284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:19.335588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:19.349844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-85be43a8-cf95-4232-8786-001ba9aa9d64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.375046 Sep 08 01:14:19.354722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 60/114] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:18 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:19.369009 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:19.370014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:19.379233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:19.382672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:19.387724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:19.388715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:19.389373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:19.390048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:19.555756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e34a5722-b60d-45da-8fb4-5df0cb8ed1ce tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "POST /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.107261 Sep 08 01:14:19.564595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 55/115] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:14:17 2022] POST /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2/os-volume_attachments => generated 194 bytes in 2117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:19.817549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:19.825131 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5244a74c-fb42-4b5f-8fad-92eeee0998bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.469127 Sep 08 01:14:19.825877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 61/116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:19 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:20.230530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:20.246387 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:20.247141 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:20.247571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:20.263155 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] Creating event network-changed:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:14:20.280078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-d1448d5b-8734-4df9-9b3a-a0e0ff51ebb5 req-698036e2-e9a0-4a38-8651-3d79e489c67c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053766 Sep 08 01:14:20.281660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 56/117] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:20.382341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:20.384572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:20.402537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:20.404111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:20.404776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:20.407577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:20.410127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:20.411733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:20.464290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:20.771056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:20.783102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7005cd5a-372a-4d3f-b688-1e4ac54a4c1f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1322 microversion: 2.1 time: 0.407105 Sep 08 01:14:20.784184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 62/118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:20 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:20.853676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:20.854550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:20.867657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:20.868160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:20.868607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:20.879006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:20.881802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:20.882279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:21.180272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:21.188052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-596bc181-02b4-4da3-8a99-fa37b9c0a32c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.340808 Sep 08 01:14:21.188663 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 57/119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:20 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:21.812738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:21.814976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:21.840982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:21.844167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:21.844810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:21.857764 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:21.864515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:21.865196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.128163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:22.136826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ac38f1a-3779-40c7-9d16-aaa5cda59af0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1516 microversion: 2.1 time: 0.330173 Sep 08 01:14:22.138178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 63/120] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:21 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1516 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:22.161697 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:22.165492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:22.173683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.174665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.175274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.176152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.176610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.177033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.207127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'flavor' on Instance uuid a982f8af-808c-4b79-bf51-ac72f1c60699 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:22.213053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:22.213675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:22.222299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.222783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.223215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.223904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.224396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.224822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.392319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-783dc118-e261-436f-bff4-44e39fada4df tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699/action" status: 200 len: 32 microversion: 2.1 time: 0.234549 Sep 08 01:14:22.392921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 58/121] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:14:22 2022] POST /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699/action => generated 32 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:14:22.403253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:22.404710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:22.413401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.413960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.414481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.415248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:22.415945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:22.418053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:22.729374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:22.729905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:22.738720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c30f8361-9622-4cf0-81aa-2379dc262935 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1363 microversion: 2.1 time: 0.530746 Sep 08 01:14:22.739605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4e080c01-4194-4997-badc-ef48b219b623 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.340643 Sep 08 01:14:22.739752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 64/122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:22 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1363 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:22.742781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 59/123] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:22 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:14:23.765789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:23.767149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:23.772792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:23.774452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:23.775404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:23.776000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:23.776874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:23.777483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:23.778488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:23.782692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:23.804899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:23.805491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:23.806672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:23.809936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:23.811943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:23.813614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:24.024080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:24.044465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9a35eb6b-d8b9-428f-a5ad-22664efe3905 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1550 microversion: 2.1 time: 0.283509 Sep 08 01:14:24.046041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 65/124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:23 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1550 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:24.077505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:24.078544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:24.094356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:24.095944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:24.100912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:24.102319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:24.102805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:24.103735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:24.303048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d51a66c-7a78-4820-8211-c3c1433fe2b0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.232026 Sep 08 01:14:24.303822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 66/125] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:14:24 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-interface => generated 285 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:24.594524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:24.603109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a2c5ac1-8a76-4dab-8c62-a0710c20711d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.835667 Sep 08 01:14:24.620173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 60/126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:23 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:25.641091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:25.641695 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:25.653354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:25.655393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:25.656022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:25.656777 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:25.657256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:25.657685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:25.971350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:25.979428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c97f336c-c090-42f6-b999-b6c738164911 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.342920 Sep 08 01:14:25.980126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 67/127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:25 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:26.244942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57bfe335-f009-4567-b8b1-b1f1fb648d59", "tag": "2b614f05-722c-4dc3-a2a4-9c0f19d70a6f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:26.261301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:26.262343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:26.262956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:26.288597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] Creating event network-changed:2b614f05-722c-4dc3-a2a4-9c0f19d70a6f for instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 on hv-cinder-84773 Sep 08 01:14:26.294556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-2fae4db6-1080-4a2d-a245-d85704e1d5a8 req-5a921f12-a443-4454-997d-d9b061aa5cf9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056660 Sep 08 01:14:26.295403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 61/128] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:27.004543 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:27.005149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:27.017649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:27.018943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:27.019458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:27.020398 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:27.021923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:27.022437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:27.205711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:27.215948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3e03e1f0-0747-47cf-8243-ebf25bbeea7c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.215893 Sep 08 01:14:27.218973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 68/129] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:26 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:28.246662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:28.248300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:28.255246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:28.255722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:28.256175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:28.256855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:28.257297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:28.257751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:28.400629 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:28.409383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b51e7dfc-2b28-48b7-9e03-030fc4875264 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.167685 Sep 08 01:14:28.410041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 62/130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:28 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:29.434856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:29.435471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:29.447975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:29.448912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:29.449800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:29.451021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:29.452455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:29.453251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:29.607013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:29.617957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1fdf7b28-0186-44eb-bbcd-b40ef382d4ac tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.186763 Sep 08 01:14:29.618535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:29 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:30.644268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:30.644873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:30.647256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=72 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:30.652870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:30.653376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:30.653859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:30.654579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:30.655840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:30.656294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:30.788309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:30.796952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6359e0a9-ee86-4204-939c-7208a9280f72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.156222 Sep 08 01:14:30.797532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 63/132] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:30 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:31.820960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:31.821476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:31.827799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:31.828306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:31.828735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:31.829417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:31.829859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:31.830277 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:31.962368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:31.970468 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-baa2203a-f4f2-4067-8138-638f9c5330fd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.153455 Sep 08 01:14:31.971120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 70/133] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:31 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:32.993724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:32.994239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:33.001053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:33.001636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:33.002081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:33.002718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:33.003174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:33.003598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:33.153342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:33.163196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c754f415-3e68-4b3c-84f2-186ec7a5d0e7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.173187 Sep 08 01:14:33.163996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 64/134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:32 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:34.189948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:34.190488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:34.196592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:34.197069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:34.197497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:34.198180 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:34.198632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:34.199064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:34.329658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:34.337298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5f0ee0ed-123d-4855-8b79-4705febdf797 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.151393 Sep 08 01:14:34.337871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 71/135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:34 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:35.360694 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:35.361301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:35.367695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:35.368204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:35.368639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:35.369318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:35.369762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:35.370178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:35.494498 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:35.502651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6dd60421-9765-4d5c-a733-fd23aa8c0124 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.145847 Sep 08 01:14:35.503227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 65/136] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:35 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:36.526367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:36.526967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:36.533058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:36.533531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:36.533958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:36.534628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:36.535072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:36.535495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:36.666235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:36.673913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0aad8d85-3862-4a33-ab77-d9a31584c2a9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.151418 Sep 08 01:14:36.674572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 72/137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:36 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:37.018194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:37.018726 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:37.024858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.025332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.025785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.026461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.026910 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.027330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.053286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:14:37.144046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89e7ab37-411c-4630-b67a-7274e3bbb56b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 204 len: 0 microversion: 2.1 time: 0.129952 Sep 08 01:14:37.145471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 66/138] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:14:37 2022] DELETE /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:14:37.153980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:37.154509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:37.161180 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.161671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.162111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.162819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.163270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.163691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.433381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:37.444302 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-39e62b10-1cf5-486d-ad68-510842ce5ec5 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1552 microversion: 2.1 time: 0.293871 Sep 08 01:14:37.444987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 73/139] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:37 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1552 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:37.699545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:37.700459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:37.706894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.707479 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.708079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.709012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:37.709634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:37.710223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:37.861228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:37.874826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9d522e2-ca15-417d-ae63-973a2de09346 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.179925 Sep 08 01:14:37.875930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 67/140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:37 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:38.471504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:38.471952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:38.477861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:38.478519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:38.478944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:38.479624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:38.480064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:38.480504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:38.674791 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:38.682932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0de264a0-62cb-468c-baa9-e82288ce92cd tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1552 microversion: 2.1 time: 0.217407 Sep 08 01:14:38.683502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 74/141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:38 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1552 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:38.898778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:38.899472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:38.906681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:38.907250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:38.907792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:38.908643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:38.909170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:38.909673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:38.933242 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:39.090982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:39.101403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-598df732-1175-4368-aede-faff443c774d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.206393 Sep 08 01:14:39.112880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 68/142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:38 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:39.710364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:39.710968 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:39.716962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:39.717523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:39.718216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:39.718900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:39.719345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:39.719765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:39.852545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:39.861379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-033d0c0b-99f2-476e-9ef9-e03c02d0282c tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1552 microversion: 2.1 time: 0.154873 Sep 08 01:14:39.862052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 75/143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:39 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1552 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:40.125529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:40.126233 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:40.132668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:40.133323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:40.133871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:40.134880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:40.135396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:40.135829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:40.291511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:40.301143 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cf168cb8-df62-4918-8eaf-9fe543df0aff tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.179901 Sep 08 01:14:40.301724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 69/144] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:40 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:40.885317 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:40.886121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:40.892890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:40.893380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:40.893793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:40.894471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:40.894915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:40.895327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:41.063105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:41.072296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac03032e-0bca-4256-ba8f-efe4b088a972 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1552 microversion: 2.1 time: 0.191068 Sep 08 01:14:41.072879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 76/145] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:40 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1552 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:41.325496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:41.326075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:41.333167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:41.333748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:41.334164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:41.334878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:41.335303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:41.335727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:41.468454 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:41.476089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bdac77ae-84cb-4afb-ba00-155b5783442f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.154570 Sep 08 01:14:41.476764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 70/146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:41 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:42.097257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:42.098375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:42.105064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:42.105823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:42.106406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:42.107254 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:42.107953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:42.108874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:42.260326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:42.268835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f229b5ce-b9b9-458d-a07b-e0fe9c7632e4 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1552 microversion: 2.1 time: 0.175725 Sep 08 01:14:42.269444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 77/147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:42 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:42.498775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:42.499382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:42.505724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:42.506200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:42.506631 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:42.507315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:42.507761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:42.508243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:42.650314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:42.658494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fa479beb-8441-469b-aed5-6b17caadc5c0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.163616 Sep 08 01:14:42.659108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 71/148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:42 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:43.300183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:43.300183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:43.304162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:43.304789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:43.305222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:43.305983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:43.306592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:43.307013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:43.408939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:43.423217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-93770339-71b8-497e-b9ff-9afd2aa6091b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1510 microversion: 2.1 time: 0.134160 Sep 08 01:14:43.423652 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f175e4b0-4032-4087-a688-77643611cbe2", "name": "network-vif-deleted", "tag": "a3feceff-0ba1-4373-bf87-ec5f1d48bab3"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:43.439827 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 78/149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:43 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:43.453536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:43.454028 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:43.454525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:43.468368 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] Creating event network-vif-deleted:a3feceff-0ba1-4373-bf87-ec5f1d48bab3 for instance f175e4b0-4032-4087-a688-77643611cbe2 on hv-cinder-84773 Sep 08 01:14:43.481575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-14aa41e3-e152-4759-8e76-95f0e44e3a15 req-7011618e-1518-4b71-bed3-547813500aea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064380 Sep 08 01:14:43.483941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 72/150] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:14:43.683111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:43.683715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:43.690524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:43.690995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:43.691421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:43.692107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:43.692581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:43.693000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:43.708969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:43.858290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:43.865914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d04ce933-9c95-4529-9d64-8798738757a3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.187105 Sep 08 01:14:43.866776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 79/151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:43 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:44.449335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:44.450499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:44.457971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:44.458448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:44.459011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:44.459855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:44.460338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:44.460761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:44.494348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:44.494831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:44.495266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:44.495714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lazy-loading 'fault' on Instance uuid f175e4b0-4032-4087-a688-77643611cbe2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:44.540466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:44.550721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b886fda9-9240-4d31-8dde-7fa4f1eaa5c6 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1350 microversion: 2.1 time: 0.107091 Sep 08 01:14:44.551309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 73/152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:44 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:44.893432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:44.894048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:44.900214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:44.900688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:44.901118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:44.901880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:44.902328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:44.902747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:45.056631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:45.065239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5aef432e-dc64-4bc0-896f-fc40f8ea1c57 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.176349 Sep 08 01:14:45.065923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:44 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:45.574372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:45.574985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:45.582414 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:45.582892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:45.583327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:45.584238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:45.584694 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:45.585120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:45.616156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:45.616640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:45.623834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:45.624338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lazy-loading 'fault' on Instance uuid f175e4b0-4032-4087-a688-77643611cbe2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:45.672674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:45.680951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a7fd055-bdbf-4820-b0c2-5fa588651c5b tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1350 microversion: 2.1 time: 0.110493 Sep 08 01:14:45.681626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:45 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:46.088943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:46.089555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:46.095570 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:46.095984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:46.096617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:46.097143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:46.097593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:46.098016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:46.240319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:46.248727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f3b869c5-cf21-4e1a-ae27-920a152976e5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.162970 Sep 08 01:14:46.249307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 81/155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:46 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:46.705032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:46.705675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:46.712003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:46.712529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:46.712966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:46.713645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:46.714099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:46.714521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:46.754090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:46.754605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:46.755034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:46.755469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lazy-loading 'fault' on Instance uuid f175e4b0-4032-4087-a688-77643611cbe2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:46.795586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:46.803491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-65020c75-2d24-424d-82d6-d020b509288e tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1350 microversion: 2.1 time: 0.102974 Sep 08 01:14:46.804049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 75/156] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:46 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:47.273323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:47.273885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:47.279971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:47.280507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:47.280957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:47.281636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:47.282087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:47.282514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:47.413687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:47.422851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e1237da6-6cdb-4396-8589-c99fcf6c1d25 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.153710 Sep 08 01:14:47.423451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 82/157] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:47 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:47.826793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:47.827407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:47.833590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:47.834069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:47.834504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:47.835189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:47.835638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:47.836068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:47.869680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:47.870157 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:47.870591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:47.871030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lazy-loading 'fault' on Instance uuid f175e4b0-4032-4087-a688-77643611cbe2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:47.915454 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fe14a406444624a34a73e2ad60a75c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1186c0555f345b6915c81b1f33b84bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:47.924019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c792cda4-e807-4651-81ce-d6e6a81d5fa0 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 200 len: 1350 microversion: 2.1 time: 0.101662 Sep 08 01:14:47.924618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:47 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 1350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:48.446382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:48.446897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:48.453782 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:48.454253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:48.454691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:48.455385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:48.455839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:48.456300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:48.595048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:48.604417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5d2e85bc-be0c-43fb-bab0-a269471001cb tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.161738 Sep 08 01:14:48.605002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 83/159] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:48 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:48.949400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:48.949911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:48.963093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:48.963578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:48.964013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:48.964773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:48.965271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:48.965651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:48.983061 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] HTTP exception thrown: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Request method failure captured: Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 HTTP/1.1 Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG5QJxIjB9wiJAt1cDSSJd-_o2nYcRHF7mnFRlnQs7M6WFp3tLhJut7A8CQPIIAkw4nMLC3yQbi5jaRUBzMH3UWfS7KFllP0OKAQKGcllaqHHkDrurTY47v-KTZRuDiPLL2D47lCy-rGL1wsIBUu1UqzbQaDwJkgRYtQtmecoI3n7w Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:14:48.988373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c1186c0555f345b6915c81b1f33b84bc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c1186c0555f345b6915c81b1f33b84bc"}]}] Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 36fe14a406444624a34a73e2ad60a75c Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:48.989696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f175e4b0-4032-4087-a688-77643611cbe2'} Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:14:48.990483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:48.991576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:48.994209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Returning 404 to user: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:14:48.994209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-af57de1f-039b-433d-91f8-bbe38f5e93fc tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 404 len: 111 microversion: 2.1 time: 0.048188 Sep 08 01:14:48.994536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 77/160] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:48 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:14:49.114383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:49.116621 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:49.118514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=50 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:14:49.125267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:49.126213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:49.126822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:49.127639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:49.128123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:49.128583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:49.142904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] HTTP exception thrown: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Request method failure captured: Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2/os-volume_attachments HTTP/1.1 Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG5QJxIjB9wiJAt1cDSSJd-_o2nYcRHF7mnFRlnQs7M6WFp3tLhJut7A8CQPIIAkw4nMLC3yQbi5jaRUBzMH3UWfS7KFllP0OKAQKGcllaqHHkDrurTY47v-KTZRuDiPLL2D47lCy-rGL1wsIBUu1UqzbQaDwJkgRYtQtmecoI3n7w Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:14:49.148059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c1186c0555f345b6915c81b1f33b84bc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c1186c0555f345b6915c81b1f33b84bc"}]}] Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 36fe14a406444624a34a73e2ad60a75c Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:49.149509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'server_id': 'f175e4b0-4032-4087-a688-77643611cbe2'} Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:14:49.150366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:49.151653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:49.153745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Returning 404 to user: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:14:49.155612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-821a2a0f-f1c7-4f60-9af1-4df739c1e163 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045284 Sep 08 01:14:49.156276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 84/161] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:14:49 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:14:49.633352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:49.634229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:49.642545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:49.643117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:49.643694 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:49.644489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:49.645178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:49.645648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:49.803386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:49.811540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-44e8232a-0775-481d-b5ed-8d4358486909 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.183356 Sep 08 01:14:49.812361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 78/162] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:49 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:50.394698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:50.395246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:50.402344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.403120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.404908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:50.406019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.406694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.407334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:50.423590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] HTTP exception thrown: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Request method failure captured: Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 HTTP/1.1 Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG5QJxIjB9wiJAt1cDSSJd-_o2nYcRHF7mnFRlnQs7M6WFp3tLhJut7A8CQPIIAkw4nMLC3yQbi5jaRUBzMH3UWfS7KFllP0OKAQKGcllaqHHkDrurTY47v-KTZRuDiPLL2D47lCy-rGL1wsIBUu1UqzbQaDwJkgRYtQtmecoI3n7w Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:14:50.426154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c1186c0555f345b6915c81b1f33b84bc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c1186c0555f345b6915c81b1f33b84bc"}]}] Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 36fe14a406444624a34a73e2ad60a75c Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.427332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'f175e4b0-4032-4087-a688-77643611cbe2'} Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:14:50.427986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.429121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.431262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Returning 404 to user: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:14:50.431262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-75dbe27f-1503-4c27-a161-007aa8ffa2e9 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 404 len: 111 microversion: 2.1 time: 0.036783 Sep 08 01:14:50.431720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 85/163] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:14:50 2022] DELETE /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:14:50.436761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:50.437431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] [instance: f175e4b0-4032-4087-a688-77643611cbe2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:50.444031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.444565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.444998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:50.445762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.446218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.446684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:50.461778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] HTTP exception thrown: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Request method failure captured: Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 HTTP/1.1 Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG5QJxIjB9wiJAt1cDSSJd-_o2nYcRHF7mnFRlnQs7M6WFp3tLhJut7A8CQPIIAkw4nMLC3yQbi5jaRUBzMH3UWfS7KFllP0OKAQKGcllaqHHkDrurTY47v-KTZRuDiPLL2D47lCy-rGL1wsIBUu1UqzbQaDwJkgRYtQtmecoI3n7w Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:14:50.463334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1186c0555f345b6915c81b1f33b84bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c1186c0555f345b6915c81b1f33b84bc", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c1186c0555f345b6915c81b1f33b84bc"}]}] Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: c1186c0555f345b6915c81b1f33b84bc Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-DeleteServersTestJSON-445972313 Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 36fe14a406444624a34a73e2ad60a75c Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-DeleteServersTestJSON-445972313-project Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.464623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'f175e4b0-4032-4087-a688-77643611cbe2'} Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:14:50.465266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. Sep 08 01:14:50.466944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:14:50.468274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] Returning 404 to user: Instance f175e4b0-4032-4087-a688-77643611cbe2 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:14:50.468274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-459f0b38-330d-45c0-a6c0-98c439ddc360 tempest-DeleteServersTestJSON-445972313 tempest-DeleteServersTestJSON-445972313-project] 10.222.0.42 "GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2" status: 404 len: 111 microversion: 2.1 time: 0.032466 Sep 08 01:14:50.468274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:50 2022] GET /compute/v2.1/servers/f175e4b0-4032-4087-a688-77643611cbe2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:14:50.835430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:50.836041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:50.842435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.842920 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.843356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:50.844058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:50.844541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:50.844964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:51.065261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:51.082244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f6932632-e8c6-4525-9eb4-ec35c5360cbc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.243414 Sep 08 01:14:51.082944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 86/165] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:50 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:52.107914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:52.111559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:52.121374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:52.121957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:52.123193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:52.124448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:52.125280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:52.125951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:52.406660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:52.417123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-192445b1-f1af-44a1-8b79-1aafd324148a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.315396 Sep 08 01:14:52.417689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:52 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:53.458809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:53.460561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:53.473205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:53.474759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:53.476013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:53.477463 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:53.478079 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:53.479162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:54.038217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:54.051737 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e36365ca-3a7f-4b79-8e46-464536f67bc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.613456 Sep 08 01:14:54.053550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 87/167] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:53 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:55.079566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:55.080202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:55.090233 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:55.091979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:55.092799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:55.093697 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:55.094553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:55.095882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:55.506290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:55.523349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-605b5501-0f61-4a17-bd2a-4b328129c947 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1522 microversion: 2.1 time: 0.445667 Sep 08 01:14:55.544815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 81/168] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:55 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1522 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:56.557769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:56.559424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:56.568607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:56.569221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:56.570072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:56.570820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:56.577687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:56.578129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:56.734675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:56.743179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4f005049-c643-4f28-8717-dde5a482c5d8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1502 microversion: 2.1 time: 0.190409 Sep 08 01:14:56.744797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 88/169] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:56 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:56.774926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:56.776095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:56.783796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:56.784210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:56.784785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:56.785650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:56.786127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:56.786568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:56.945287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:56.954584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-413713c9-82f1-4765-9ea1-8e1b922ed7bf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1515 microversion: 2.1 time: 0.183632 Sep 08 01:14:56.956581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:56 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1515 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:14:58.657758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:14:58.660089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:58.681284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:58.684801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:58.686659 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:58.689660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:58.693769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:58.693769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:58.759979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'flavor' on Instance uuid 3d582038-e2ec-4bbc-ad3e-2300a1351fee {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:14:58.967329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-041144f8-75ce-4ab1-b78b-19407a2e7d50 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/action" status: 200 len: 32 microversion: 2.1 time: 0.311933 Sep 08 01:14:58.969208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 89/171] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:14:58 2022] POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/action => generated 32 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:14:58.979653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:14:58.980273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:14:58.994933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:58.995576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:58.996022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:58.997080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:14:58.998084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:14:59.007348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:14:59.486295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:14:59.500583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f9a5c7d7-2930-4519-8a17-5c402b46ac3d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.524543 Sep 08 01:14:59.501443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 83/172] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:14:58 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:00.525189 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:00.526736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:00.540273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:00.540954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:00.541763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:00.545463 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:00.548652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:00.551391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:01.000471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:01.008635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d8988432-51af-420c-a107-afa7e51307c3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.487762 Sep 08 01:15:01.009475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 90/173] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:00 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:02.033825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:02.035099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:02.051570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:02.057550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:02.058047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:02.058473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:02.059174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:02.059625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:02.066424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:02.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:02.470628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-750572e1-5a06-4608-8533-3dbc38c6945f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.442042 Sep 08 01:15:02.471211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 84/174] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:02 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:03.495426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:03.496199 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:03.506417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:03.506921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:03.507364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:03.508078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:03.508639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:03.509312 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:03.758725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:03.767502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ef5165a3-3d5b-4204-a60e-a3fc266f0682 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.276258 Sep 08 01:15:03.789941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 91/175] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:03 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:04.797806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:04.799361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:04.811385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:04.812740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:04.813388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:04.816295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:04.816989 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:04.818405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:05.189345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:05.192884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:05.205014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1d5cc24d-568d-4f38-8404-87b508221a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.411755 Sep 08 01:15:05.206676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 85/176] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:04 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:06.213632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3d39ede2-51c0-44b6-86fe-d24bce283799 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: .version_select at 0x7fe9c9d7cdc0>, body: {"keypair": {"name": "tempest-keypair-1857616494", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeiYwq00ecVvqV3+GleZZEMXQM1mx8B92xcrLPcqFeS0bCX02bo4T+h0H6M14G9aAxqQvew/OJVBcNOrQUDABppx0fdU2Pa0d7yTdas3/FE5YBQ6pH+3x1gYboTOswNCg=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:06.230452 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:06.231396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:06.239694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-3d39ede2-51c0-44b6-86fe-d24bce283799 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:06.244763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-3d39ede2-51c0-44b6-86fe-d24bce283799 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:06.254638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:06.255136 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:06.255569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:06.256315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:06.256939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:06.257519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:06.293414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3d39ede2-51c0-44b6-86fe-d24bce283799 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.381738 Sep 08 01:15:06.302541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 92/177] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:15:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:06.513615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:06.526300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cc57bdb5-14f9-4924-9897-d27e15de3f85 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.300101 Sep 08 01:15:06.548758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 86/178] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:06 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:07.553747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:07.555303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:07.573625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:07.574486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:07.575706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:07.578181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:07.578917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:07.580230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:07.979361 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:07.997999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3451526c-0a4e-412f-ac11-21ec2fb40210 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.445357 Sep 08 01:15:07.998636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 93/179] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:07 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:09.026057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:09.026676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:09.035440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:09.035920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:09.036385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:09.043088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:09.043821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:09.045991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:09.272282 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1629019846", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e9407ec-0cf4-40eb-abcb-b44e26ace243"}], "security_groups": [{"name": "tempest-securitygroup--543122530"}], "key_name": "tempest-keypair-1857616494", "user_data": "}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:09.371848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:09.381757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f4e1f26e-143c-4889-bf0e-222545df13ec tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.359454 Sep 08 01:15:09.382337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:09 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:09.455095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] validate_networks() for [('9e9407ec-0cf4-40eb-abcb-b44e26ace243', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:10.139648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:10.140118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:10.140629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:10.141097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:10.145794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:10.173634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:10.176907 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:10.177806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:10.179244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:10.181541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:10.183329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:10.229872 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:10.242780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:10.304044 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:10.314087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:10.414285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dd9edc09-a920-46a1-b639-f15aa35604c9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.147145 Sep 08 01:15:10.415258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 94/181] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:10.419936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:10.425169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:10.426210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9f8307a8-1af6-4fd7-9375-f170dc37ef1c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:10.426826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9f8307a8-1af6-4fd7-9375-f170dc37ef1c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:10.450739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:10.454549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:10.455209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:10.456301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:10.458185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:10.460276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:10.563347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9f8307a8-1af6-4fd7-9375-f170dc37ef1c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:10.571927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9f8307a8-1af6-4fd7-9375-f170dc37ef1c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1242 microversion: 2.1 time: 0.149511 Sep 08 01:15:10.578723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 95/182] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:10 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1242 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:11.049418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:11.063637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f5e2ecf7-a42a-408f-ac5e-67ddd8a1bfcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.660900 Sep 08 01:15:11.064907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 88/183] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:10 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:11.602631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:11.603257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:11.610027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:11.610522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:11.610961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:11.611671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:11.612118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:11.612796 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:11.686563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:11.697935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7bfa715a-55e8-4e0c-bf3b-86cb3ee78a04 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1246 microversion: 2.1 time: 0.099173 Sep 08 01:15:11.712955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 96/184] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:11 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:12.097717 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:12.099555 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:12.107791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:12.108632 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:12.109235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:12.110101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:12.110713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:12.111418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:12.563281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:12.577105 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fc6acb6d-8fb9-4bd4-96ee-d581d5285aad tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.483402 Sep 08 01:15:12.579060 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 89/185] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:12 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:12.734230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:12.734671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:12.767853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:12.769989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:12.770599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:12.771214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:12.771678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:12.781579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:12.977878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:12.988039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4767a5ea-7d4f-4eca-a580-ae96388ea482 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1294 microversion: 2.1 time: 0.270303 Sep 08 01:15:12.991833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 97/186] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:12 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1294 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:13.607439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:13.608290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:13.625018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:13.626216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:13.626721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:13.627503 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:13.627975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:13.628452 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:13.949076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:13.960827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b0deb197-b9ba-4c56-bf64-011f97109e87 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.357770 Sep 08 01:15:13.962014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 90/187] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:13 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:14.017299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:14.018678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:14.041806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:14.049944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:14.049944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:14.056450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:14.062076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:14.062686 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:14.069910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:14.322728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:14.335486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a03d3f0e-0b12-44e3-8ae9-c4f12abe5564 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1294 microversion: 2.1 time: 0.322893 Sep 08 01:15:14.351718 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 98/188] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:14 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:14.987133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:14.987741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:15.014626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.017158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.021101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.025004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.025651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.026382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.364477 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:15.365080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:15.375871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.384217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.384877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.385832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.386456 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.387352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.565618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:15.582103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6ef2c53f-4f6b-4f6e-8b7d-a0af1859a906 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1501 microversion: 2.1 time: 0.598246 Sep 08 01:15:15.584086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:15.584573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 91/189] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:14 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1501 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:15.600112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-621cb35f-9444-494e-86d2-25740b9d3288 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1300 microversion: 2.1 time: 0.239728 Sep 08 01:15:15.605745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 99/190] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:15 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:15.633490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "661542e8-a0d0-4f95-8e48-cd9513d00f85"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:15.644412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:15.663903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.665258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.665699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.666412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.672347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.672908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.732268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] HTTP exception thrown: Cannot 'attach_volume' instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee while it is in vm_state rescued Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Request method failure captured: Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/os-volume_attachments HTTP/1.1 Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 74 Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG__Wf4mSFJF-q4KkfIdpEprqCkTrzo5YXOLw946PqSzz9gHlrtgc3sV9ROQvEfB4vnWlCUbaAgcgvYaYubxac0jZibBE-19dVA3xbcGAP4PYPktKnAcvi1061czlEWieZwaM-YisPxSPZVr9nz5CMMu5If6EToYYRq2o3nQ-USdIo Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:15:15.741313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f520f61ec5304a72ac707318d3a73b4f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f520f61ec5304a72ac707318d3a73b4f"}]}] Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 20af4425b7434d2dab7baeacbb845387 Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {"volumeAttachment": {"volumeId": "661542e8-a0d0-4f95-8e48-cd9513d00f85"}} Sep 08 01:15:15.742627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Cannot 'attach_volume' instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee while it is in vm_state rescued Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'server_id': '3d582038-e2ec-4bbc-ad3e-2300a1351fee', 'body': {'volumeAttachment': {'volumeId': '661542e8-a0d0-4f95-8e48-cd9513d00f85'}}} Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:15:15.743309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee while it is in vm_state rescued Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:15:15.744443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:15:15.745481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:15:15.745481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:15:15.745481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee while it is in vm_state rescued Sep 08 01:15:15.745481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:15.749936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Returning 409 to user: Cannot 'attach_volume' instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee while it is in vm_state rescued {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:15:15.753442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3aa2c2d5-fd43-4693-a84d-799b0ea8402d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.129557 Sep 08 01:15:15.754417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 92/191] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:15:15 2022] POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/os-volume_attachments => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 01:15:15.764756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:15.765779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:15.779993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.783255 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.784899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.787458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:15.788108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:15.790351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:15.983265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:15.984394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:15.991295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cda93af6-c7c9-40ec-8cdb-8337d54d04f5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/action" status: 202 len: 0 microversion: 2.1 time: 0.231299 Sep 08 01:15:15.993675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 100/192] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:15:15 2022] POST /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:15:16.001308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.003123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.003919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.005939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:16.006843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.011548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.012066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:16.015761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.029734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.030239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.030678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.032876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.033536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.035386 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.112033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-682340de-fd2f-48d9-880c-9723cd776dd3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/ips" status: 200 len: 153 microversion: 2.20 time: 0.133718 Sep 08 01:15:16.126234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 93/193] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 8 01:15:15 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/ips => generated 153 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 01:15:16.364287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:16.372481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-66385c0e-bcbc-4bb3-8d79-7fcffd1dbc4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1509 microversion: 2.1 time: 0.373504 Sep 08 01:15:16.378529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 101/194] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:15 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:16.639276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:16.640250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:16.668064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.670928 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.671384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.672124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:16.683171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:16.687546 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:16.789353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1718382517", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "networks": [{"uuid": "fa579fdb-88da-425f-b3f9-01e317248a84"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:16.904442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] validate_networks() for [('fa579fdb-88da-425f-b3f9-01e317248a84', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:17.069462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:17.107961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-121935a9-daa1-44f9-847e-d6dec08b763f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.474087 Sep 08 01:15:17.115444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 94/195] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:16 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:17.399560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:17.400200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:17.409486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:17.410015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:17.410455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:17.411167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:17.411620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:17.412050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:17.749282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:17.766132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d723ef36-64f9-4e74-a030-d34b920d1f6a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1509 microversion: 2.1 time: 0.370327 Sep 08 01:15:17.766718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 95/196] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:17 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1509 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:17.777843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:17.778526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:17.779241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:17.779650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:17.780058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:17.784036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1837989309", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:17.796673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:17.797155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:17.803221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:17.804342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:17.804828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:17.805258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:17.854540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Getting quotas for project 8263d46be0db47ce9191c099759cf0e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:17.859813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Getting quotas for user e5351a59a0294f59b6b26ddc22ba7ffa and project 8263d46be0db47ce9191c099759cf0e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:17.893730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] validate_networks() for None {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:17.896428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:17.899512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:17.973747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8cd8f98b-6c84-4cdd-9460-d95066043691 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.188609 Sep 08 01:15:17.980206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 102/197] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:17.989834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bfd5513f-d240-4bb8-9097-b3677b944376 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:17.991075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bfd5513f-d240-4bb8-9097-b3677b944376 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:18.063581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bfd5513f-d240-4bb8-9097-b3677b944376 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:18.075564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bfd5513f-d240-4bb8-9097-b3677b944376 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1214 microversion: 2.1 time: 0.092947 Sep 08 01:15:18.089919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 103/198] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:17 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:18.164652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:18.165447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:18.181878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:18.182356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:18.182849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:18.183611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:18.184174 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:18.185577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:18.530293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:18.540205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-78e3f76b-8f30-4189-bdb0-6a0d423c8cec tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.388927 Sep 08 01:15:18.541293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 104/199] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:18 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:18.793267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:18.795449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:18.802147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:18.803033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:18.803580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:18.804445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:18.805389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:18.805953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:18.985087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:18.996925 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4e7c64da-9d7e-4228-96a4-f4b59646764f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1509 microversion: 2.1 time: 0.208064 Sep 08 01:15:18.997889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 105/200] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:18 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:19.001483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:19.001992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:19.002357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:19.002768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:19.003179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:19.005244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:19.005864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:19.014549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.015030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.015469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.017295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.017969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.018569 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.019441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.020045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.020653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.020775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.021192 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.021623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.040730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Getting quotas for project 5deaa920a59448268a4151c845bb7851. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:19.046096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Getting quotas for user 9851332c4fdf4874bb3e860f0035fd4b and project 5deaa920a59448268a4151c845bb7851. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:19.050690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'flavor' on Instance uuid e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:15:19.058105 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:19.060642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:19.123874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-13abe9d8-c1f6-46c1-b652-6c82a0d39fff tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355628 Sep 08 01:15:19.125260 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 96/201] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1358 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:19.132591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:19.133423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:19.143256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.144108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.144875 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.145866 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.146534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.147501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.259478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:19.294362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6bccfc8a-96dc-4283-8553-10b932badbb3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1218 microversion: 2.1 time: 0.166482 Sep 08 01:15:19.300964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 97/202] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:19 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:19.321816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-56d76473-b15f-4093-988a-b2ce5f233b0f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:19.325288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-56d76473-b15f-4093-988a-b2ce5f233b0f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:19.390473 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1f530bbc-1676-41bb-8b60-52dafa82f37f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/action" status: 202 len: 0 microversion: 2.20 time: 0.391096 Sep 08 01:15:19.393078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 106/203] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 8 01:15:18 2022] POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:15:19.399417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0def3b08-5561-4931-922e-84d954c7949e", "tag": "ea84e823-ad97-4efb-b4c3-42cdbf5d23df"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:19.406522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:19.414227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.416082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.416750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.433693 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-56d76473-b15f-4093-988a-b2ce5f233b0f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:19.434906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] Creating event network-changed:ea84e823-ad97-4efb-b4c3-42cdbf5d23df for instance 0def3b08-5561-4931-922e-84d954c7949e on hv-cinder-84773 Sep 08 01:15:19.440536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-2dfc3107-0967-4abd-b20c-9fde221cef93 req-ef3f75df-e6fc-45e8-ae6e-5bdedfc2c8be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045724 Sep 08 01:15:19.441342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 107/204] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:19.443779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-56d76473-b15f-4093-988a-b2ce5f233b0f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1215 microversion: 2.1 time: 0.139852 Sep 08 01:15:19.444638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 98/205] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:19 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:19.462672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:19.463380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:19.474440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.475536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.475977 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.476759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.477213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.477635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.568721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:19.569672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:19.578315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.578936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.579496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.580419 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:19.581151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:19.581674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:19.733406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:19.748683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:19.750146 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:19.751333 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d00aeb7-319a-4f6a-a201-3c304468ec73 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.294186 Sep 08 01:15:19.756494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 108/206] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:19 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:20.022012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:20.022654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:20.030256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:20.038857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.039572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.041891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6e2f72d3-c6fe-4289-a02b-44e8e31e46ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.480582 Sep 08 01:15:20.042660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 99/207] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:19 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:20.043276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.044211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.044909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.045486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.186866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:20.195440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb66754d-99c6-44e3-8786-5c95dcaf5c61 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1515 microversion: 2.1 time: 0.177251 Sep 08 01:15:20.196016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 109/208] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:20 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:20.327736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:20.328632 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:20.335395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.335880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.336342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.337041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.337488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.337911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.419057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:20.429632 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f31f6bb3-04a7-49ce-a33e-7831ee6b1681 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1210 microversion: 2.1 time: 0.106181 Sep 08 01:15:20.430858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 100/209] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:20 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:20.470402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:20.470986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:20.477279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.477771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.478207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.478915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.479955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.480356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.611119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:20.627514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e262c5b7-9ac0-495e-9751-32e482d75524 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1219 microversion: 2.1 time: 0.160757 Sep 08 01:15:20.628453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 110/210] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:20 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:20.785820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:20.786562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:20.801579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.802266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.802861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:20.803718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:20.804428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:20.805322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.012682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.022113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.024180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.025771 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6273b8f6-c67d-4ac5-bc50-fabe22b9e801 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.244494 Sep 08 01:15:21.026606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 101/211] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:20 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:21.066868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:21.067523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:21.074301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.075529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.076335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.077203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.077822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.079075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.238833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.249066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c49686e0-d771-418b-b6b9-1b8536aff802 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.186096 Sep 08 01:15:21.249824 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 111/212] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:21 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:21.454651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:21.455233 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:21.463152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.464047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.464787 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.466060 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.467088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.468190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.560370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.571172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-53537256-a5eb-44da-abc4-eaaac3305a3f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1274 microversion: 2.1 time: 0.121154 Sep 08 01:15:21.571752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 102/213] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:21 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:21.653324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:21.654523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:21.664599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.680370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.680370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.680370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.680370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.680675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.691597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59e5b4e1-137e-4fb1-a826-6a501521eaf3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: .version_select at 0x7fe9c9c9c820>, body: {"keypair": {"name": "tempest-keypair-66559868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk3wVZbQXow2q/7Q8frlbGzX7MzpkR8r/fAwVyjhTirLO/n/+ynkxrDJQ3HKwuQpI20hXNCwjUWSnHgawaS79t8z9x69XaSDZqbLAH0ACyA/FthQGrkvNzNLuhb74xrdw=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:21.710065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-59e5b4e1-137e-4fb1-a826-6a501521eaf3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for project f520f61ec5304a72ac707318d3a73b4f. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:21.714617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-59e5b4e1-137e-4fb1-a826-6a501521eaf3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for user 20af4425b7434d2dab7baeacbb845387 and project f520f61ec5304a72ac707318d3a73b4f. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:21.747160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59e5b4e1-137e-4fb1-a826-6a501521eaf3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.058866 Sep 08 01:15:21.754104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 103/214] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:15:21 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:15:21.755697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:21.765224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a55e3fd1-1332-4a7b-a08b-27f65b697926 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1267 microversion: 2.1 time: 0.116471 Sep 08 01:15:21.780173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:21 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:21.949896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:21.950994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:21.963813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.964380 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.964707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:21.965827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:21.966292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:21.966720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.011803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cfabbfab-1625-4ed5-8811-b9d6648d1b77 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/ips" status: 200 len: 147 microversion: 2.1 time: 0.066651 Sep 08 01:15:22.016345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 104/216] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:15:21 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/ips => generated 147 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:22.069612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:22.075183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:22.086587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.087120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.087563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.088359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.088886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.089322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.274044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:22.274660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:22.281939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.282863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.283509 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.285007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.285930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.286374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.353835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:22.379542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:22.381432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:22.386970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aaef9e53-20bb-4759-b3c6-ce092cad2eaa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.331240 Sep 08 01:15:22.387957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 113/217] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:22 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:22.597131 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:22.598128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:22.607143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.610588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.611150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.611974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.612741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.613687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.621366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:22.727825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:22.737696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1bbb197d-5899-406c-8967-197feda14b93 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.467445 Sep 08 01:15:22.744884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:22.753693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-348b3fa2-006f-44e6-866a-a26e9c79513d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1284 microversion: 2.1 time: 0.160347 Sep 08 01:15:22.757035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 114/218] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:22 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:22.760565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 105/219] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:22 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:22.790156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:22.790856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:22.799782 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.800730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.800730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.805613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:22.806188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:22.806746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:22.998537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:23.013173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e7789329-dd7e-4f4a-820f-32296c0b47e9 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1267 microversion: 2.1 time: 0.227005 Sep 08 01:15:23.014931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 115/220] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:22 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:23.235322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a8db4c57-a277-4021-be94-a2b4c2995a23 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'create', calling method: .version_select at 0x7fe9c9e4c8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1471928182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqocfiNPylQKO10AiBRw0MEVxrpkEI2W0jHqaoMwtOu9eidijC1HUdOUKlwodntH4YKtcaXdIAunpRPoQHhiauHA7jfVeTksASO2GTgWUj4cRcJ96AGh1rtHVfzB7EXZw=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:23.269563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a8db4c57-a277-4021-be94-a2b4c2995a23 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Getting quotas for project 275f1c82d4f34cbfa81591e5f5a13f63. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:23.275102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a8db4c57-a277-4021-be94-a2b4c2995a23 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Getting quotas for user 5411bb3267704943aea31c4bf1b4c9d1 and project 275f1c82d4f34cbfa81591e5f5a13f63. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:23.301437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a8db4c57-a277-4021-be94-a2b4c2995a23 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.070001 Sep 08 01:15:23.302075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 106/221] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:15:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:23.418336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:23.421694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:23.436885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:23.437389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:23.441196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:23.442747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:23.444671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:23.445357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:23.458227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-631069127", "imageRef": "f9d2c8f9-479c-4d52-a3fd-1932fc364221", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1471928182", "networks": [{"uuid": "32f26c88-2f20-42a5-a433-7c7b41c2e6ba"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:23.563056 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] validate_networks() for [('32f26c88-2f20-42a5-a433-7c7b41c2e6ba', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:24.052876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.063038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.064542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.066058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-48780c6b-b814-4dbb-8cf4-780d64513914 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.656049 Sep 08 01:15:24.066729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 116/222] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:23 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:24.071833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:24.072501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:24.078683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.079165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.079598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.080345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.080961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.081542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.425497 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:24.426004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:24.426384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:24.426793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:24.427208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:24.434694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.446244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f9227696-6658-4242-997c-1d85a7616864 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.377876 Sep 08 01:15:24.447208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 117/223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:24 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:24.453979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:24.454801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:24.462117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.463195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.463908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.464711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.466067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.466371 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.473484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.474006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.474645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.475540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.475981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.476430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.485073 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.501606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Getting quotas for project 275f1c82d4f34cbfa81591e5f5a13f63. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:24.507023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Getting quotas for user 5411bb3267704943aea31c4bf1b4c9d1 and project 275f1c82d4f34cbfa81591e5f5a13f63. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:24.522510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:24.525142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f9d2c8f9-479c-4d52-a3fd-1932fc364221',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:24.583008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89a973f8-c438-4fc1-a274-7c3a5038d1ae tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129860 Sep 08 01:15:24.590785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 107/224] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:24.595971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:24.596924 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:24.599839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:24.606625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.607379 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.609219 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.610107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:24.610879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:24.611364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:24.744129 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.765996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5e585250-4e01-4f4b-b776-f3086d1c2784 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1273 microversion: 2.1 time: 0.179967 Sep 08 01:15:24.784172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 108/225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:24 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:24.784172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1005099479", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1b21a81-0c0e-49e3-be8e-e6c5c961479f"}], "security_groups": [{"name": "tempest-securitygroup--1778092"}], "key_name": "tempest-keypair-66559868", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:24.822905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.832165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a47880ca-2f88-4c88-8d89-f6bb76836093 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.383115 Sep 08 01:15:24.842258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 118/226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:24 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:24.854067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb933072-2992-4b51-8826-8e65008eed4d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:24.854677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb933072-2992-4b51-8826-8e65008eed4d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:24.975342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb933072-2992-4b51-8826-8e65008eed4d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:24.987453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb933072-2992-4b51-8826-8e65008eed4d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1258 microversion: 2.1 time: 0.144021 Sep 08 01:15:24.988975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 119/227] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:24 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1258 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:24.996000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5deda23a-8007-42b0-b76a-0d7354127038"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:24.998606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] validate_networks() for [('f1b21a81-0c0e-49e3-be8e-e6c5c961479f', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:25.002666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:25.010106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:25.010586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:25.011017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:25.011705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:25.012835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:25.013665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:25.449873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-27b7515c-683a-4dc8-a755-5d3a1c8f9526 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459139 Sep 08 01:15:25.452909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 120/228] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:15:24 2022] POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:25.457395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:25.458499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:25.467108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:25.467600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:25.468031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:25.468769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:25.470167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:25.470592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.028501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.050272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.054478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.056881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cf6e3fd2-1483-42db-97e8-cd06bb188390 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.603596 Sep 08 01:15:26.072162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 121/229] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:25 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:26.072162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:26.072162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:26.080155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.081839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.082640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.084120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.084951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.085811 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.157779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:26.158359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:26.158806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:26.159275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:26.159755 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:26.177786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.178605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.181862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.182862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.184424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.184578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.236636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:26.251950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Getting quotas for user 20af4425b7434d2dab7baeacbb845387 and project f520f61ec5304a72ac707318d3a73b4f. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:26.271407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:26.275304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:26.333366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a2a78357-93ab-4a6d-a7e2-037e86e63c56 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.561865 Sep 08 01:15:26.340804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 109/230] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:26.340804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:26.340804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:26.348443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.349265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.349952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.350883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.351564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.352226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.413703 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.425326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-05df54b2-3e73-4850-bd04-c2fd02448014 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.361656 Sep 08 01:15:26.426112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 122/231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:26 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:26.430987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:26.431772 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:26.438601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.439290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.439876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.440846 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.441478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.442062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.522684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.540943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-03b460aa-32ab-4bf5-ae0f-d332a6da4eeb tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.205390 Sep 08 01:15:26.541540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 110/232] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:26 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:26.547795 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:26.548433 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:26.560927 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.561529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.562090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.562900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.563456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.563978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.697415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.712720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59ee952a-e207-489e-9697-85010780b5cf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1310 microversion: 2.1 time: 0.170067 Sep 08 01:15:26.725188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 111/233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:26 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1310 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:26.735530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dccb51f-a617-41d2-bd73-b2d2844e372c", "tag": "f5a8a140-01e0-44a0-a28b-db371a7406c5"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:26.748598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:26.749081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:26.751624 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:26.772987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] Creating event network-changed:f5a8a140-01e0-44a0-a28b-db371a7406c5 for instance 4dccb51f-a617-41d2-bd73-b2d2844e372c on hv-cinder-84773 Sep 08 01:15:26.783536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-78bff0c2-a483-4837-88d8-78cd8b121cb7 req-783e0df7-3a31-4fd3-a57a-14f830ba0694 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056956 Sep 08 01:15:26.785844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 112/234] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:26.799020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4a71d87-a166-41f1-85f3-736ec3946078 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:26.799942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4a71d87-a166-41f1-85f3-736ec3946078 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:26.874594 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4a71d87-a166-41f1-85f3-736ec3946078 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.882687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:26.899940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d6faa63e-def3-4e9c-8ab2-4965b493e6b5 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.472448 Sep 08 01:15:26.900911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 123/235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:26 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:26.912941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4a71d87-a166-41f1-85f3-736ec3946078 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1244 microversion: 2.1 time: 0.115743 Sep 08 01:15:26.912941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 113/236] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:26 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1244 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:27.097155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.098660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.110317 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.111181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.111961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.113242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.113955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.114500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.369896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac896548-c86b-4c3b-ae24-a97ceadfd1b2", "tag": "7a3b0f9f-81f3-465c-b3b6-fb90228f7f74"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:27.381129 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.381601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.382031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.392673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] Creating event network-changed:7a3b0f9f-81f3-465c-b3b6-fb90228f7f74 for instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 on hv-cinder-84773 Sep 08 01:15:27.397555 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-ab3d030b-ac88-4dea-ae18-3e142639808c req-a87499b3-90c9-4a85-9c22-0c686cc54ad4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031826 Sep 08 01:15:27.398177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 114/237] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:15:27.453401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.454202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.459618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.461099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.461658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.462103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.462878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.463861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.463861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.478095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.482238 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.483759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7d9969d1-8825-49b0-8466-b0f2b2b54428 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.396864 Sep 08 01:15:27.497753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 124/238] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:27.566767 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.567560 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.573658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.574145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.574890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.575594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.576067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.576770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.618289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.636178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bd998f00-cd2f-4d48-b26e-c2fdc50fd0c1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.186826 Sep 08 01:15:27.641051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 115/239] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:27.740507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.741201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.747623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.748217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.748737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.749496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.750010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.750491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.785882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.795690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0509a99b-4802-417f-9956-bf0611de41fd tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.233852 Sep 08 01:15:27.807197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 125/240] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:27.820882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:27.829177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a84cd202-d5fd-40e0-837e-72ecfe72f498 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1316 microversion: 2.1 time: 0.092567 Sep 08 01:15:27.830612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 116/241] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1316 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:27.925612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.925612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.927460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:27.931591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:27.932231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:27.935027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.935900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.937303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.939173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.939330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.939689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.940024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.940534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:27.940883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.941656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:27.942594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:27.944910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:28.018120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:28.031110 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d7824ee1-391f-4179-823a-1f86afe05bf7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.098211 Sep 08 01:15:28.044314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 117/242] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:28.053310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0def3b08-5561-4931-922e-84d954c7949e", "name": "network-vif-plugged", "status": "completed", "tag": "ea84e823-ad97-4efb-b4c3-42cdbf5d23df"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:28.067883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:28.068489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:28.068985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:28.082336 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] Creating event network-vif-plugged:ea84e823-ad97-4efb-b4c3-42cdbf5d23df for instance 0def3b08-5561-4931-922e-84d954c7949e on hv-cinder-84773 Sep 08 01:15:28.090897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-85b6490c-65b6-432f-b22c-70f631774234 req-048ecad2-8b45-4244-9dde-6f0c63487cd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042518 Sep 08 01:15:28.092321 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 118/243] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:28.188698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:28.196510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-33dadc8a-6b04-410f-91d7-d46df49b52db tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.275429 Sep 08 01:15:28.197095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 126/244] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:27 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:28.511635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:28.521558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:28.543000 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:28.547735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:28.548265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:28.549668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:28.551397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:28.551837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:28.663400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:28.664118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:28.676978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:28.677720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:28.678309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:28.679354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:28.679978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:28.681224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.001095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.010433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0cf25f4d-2026-4034-8520-f68587d14868 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.351247 Sep 08 01:15:29.024176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.024430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 127/245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:28 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:29.029587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.031127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.032292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-48e96b06-602b-4b68-b434-f3e1025c443d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.525975 Sep 08 01:15:29.033979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:29.034908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:29.047393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.048285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 119/246] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:28 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:29.050531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.052488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.053243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.053704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.054136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.056202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:29.057234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:29.067380 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.073395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.074076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.075849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.076515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.077122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.280930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.295515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-edcca346-d81d-4378-9088-cb36eab1ae15 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.243724 Sep 08 01:15:29.297315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 120/247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:29 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:29.319839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:29.321718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:29.331780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.332300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.333028 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.334162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.334617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.335038 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.362292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.370342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2a9158cf-eb29-47c1-972b-853f9b934390 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.354777 Sep 08 01:15:29.388957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 128/248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:29 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:29.397210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:29.398068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:29.405185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.405900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.406471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.407318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.407908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.408531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.435181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.448422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a61f0453-74e0-4fb9-a2c6-11570369777a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.140537 Sep 08 01:15:29.449247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 121/249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:29 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:29.605339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:29.616601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f7ef0f8f-2f9b-42b7-887a-e9456a28ea58 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.226201 Sep 08 01:15:29.632702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 129/250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:29 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:29.792500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:29.805486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:29.806133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:29.816615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:29.844282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] Creating event network-changed:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:15:29.851247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-0278712e-4b6c-41dd-9417-732cdc0c7f2a req-8527846c-f514-48d9-9466-e4b35cc5f805 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062866 Sep 08 01:15:29.852836 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 122/251] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:30.035245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.036362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.042757 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.044211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.044981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.045847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.046444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.047026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.058603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.059403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.069816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.070323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.074141 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.075025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:30.075736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.077064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.077064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.252224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.262311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-46d6c95e-214b-42b8-a740-38103a0dfad9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.230105 Sep 08 01:15:30.263489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 130/252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:30.294200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.303492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.305082 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.306393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f35b885a-3e1d-4715-8e8a-6cdbb7f44585 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.252170 Sep 08 01:15:30.307377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 123/253] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:30.330784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.331522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.338377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.338934 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.339438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.340349 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.340964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.341757 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.403441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.404267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.410713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.411198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.411628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.412373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.412826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.413250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.511507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.526687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-74f1d970-1e71-4274-bc07-924926fab4af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.204888 Sep 08 01:15:30.539793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 131/254] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:30.541813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.554892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.554892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.554892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.554892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.555335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.555335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.555335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.601811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.625255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a8aac091-e620-4ca9-af26-b773d5bc1503 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.226203 Sep 08 01:15:30.626029 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 124/255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:30.656327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:30.656952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:30.663354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.663848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.664322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.665087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:30.665548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:30.665976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:30.676722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.687979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-189e8fad-56ca-4792-9700-335e79a01f88 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.158625 Sep 08 01:15:30.691324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 132/256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:30.870525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:30.890977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7905012e-d2cc-41dc-940b-ae9c9342eba1 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.246266 Sep 08 01:15:30.913554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 125/257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:30 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:31.289584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.290657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.298028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.298541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.298980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.299697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.300394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.300821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.336154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.336762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.344248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.344746 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.345234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.345982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.347081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.347515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.469856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.480356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-797bc820-3bb2-4d51-8a7f-583740c44900 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.194459 Sep 08 01:15:31.481969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 133/258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:31.550777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.561608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.563066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.564727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1fa6fdbe-7a69-4e96-a9e3-a460d0723262 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.235605 Sep 08 01:15:31.565448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.566401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.573867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.575268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.575578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.576388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.576906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.577427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.580491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 126/259] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:31.655790 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.656696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.662808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.663288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.663806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.664534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.664984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.665428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.736012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.744502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-27d37554-b1d3-4092-aeb9-2afed8420d6c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.185210 Sep 08 01:15:31.745091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 134/260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:31.757334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.758000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.765295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.766004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.766522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.767310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.767837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.768370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.843164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.844892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:31.851338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1204fc74-310f-4904-aab1-83520b2ce4e2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.105187 Sep 08 01:15:31.851921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 135/261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:31.864150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-60130ef4-07c3-4935-862d-683605b25c3d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.216428 Sep 08 01:15:31.864860 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 127/262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:31.927455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:31.928384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:31.940485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.941067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.941725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:31.942436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:31.942982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:31.943655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.164989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.175016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8ac64620-8d72-47af-8f68-eecd8be3681d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.251379 Sep 08 01:15:32.175688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 136/263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:31 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:32.248946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dccb51f-a617-41d2-bd73-b2d2844e372c", "name": "network-vif-plugged", "status": "completed", "tag": "f5a8a140-01e0-44a0-a28b-db371a7406c5"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:32.259978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.260093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.260688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.278831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] Creating event network-vif-plugged:f5a8a140-01e0-44a0-a28b-db371a7406c5 for instance 4dccb51f-a617-41d2-bd73-b2d2844e372c on hv-cinder-84773 Sep 08 01:15:32.284922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-4678af0d-4d41-4750-a22f-821337e696a5 req-c6ca0fad-4ba9-42a6-ac47-2a16bed2e544 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040450 Sep 08 01:15:32.286205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 128/264] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:32.512982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:32.514375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:32.521111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.521672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.522380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.523647 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.523815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.524695 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.603710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:32.604446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:32.612189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.612683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.613123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.613827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.614358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.614723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.643410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:32.689868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.699105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98b27d9e-4963-4c2e-a06b-c1fcc3f4d9b2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.190053 Sep 08 01:15:32.699105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 137/265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:32 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:32.769366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:32.770188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:32.776715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.777737 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.778350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.779237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.779888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.780597 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.784241 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.793962 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.795691 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.796905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eb9555d4-436b-4dbe-a52c-020e1f6e1716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.197679 Sep 08 01:15:32.797473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 129/266] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:32 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:32.875558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:32.876372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:32.883603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.884641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.885081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.885781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.886395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.887410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.922879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.930843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ae8d0a2f-3281-49f4-bcd2-728e6bced03c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.165465 Sep 08 01:15:32.931412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 138/267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:32 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:32.948503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:32.950149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:32.957788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.958534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.959043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.959167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:32.959912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:32.960484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:32.961077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:32.967693 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6b7594d-4b7a-44ab-96dc-fcb6434ed2f8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.096654 Sep 08 01:15:32.968292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 130/268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:32 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:33.109587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:33.117383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c264383c-0c7c-435f-bd4c-755caf7830ab tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.184962 Sep 08 01:15:33.117959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 139/269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:32 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:33.199009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:33.199839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:33.206166 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.206720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.207163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.207886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.208374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.208802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.345957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:33.353826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-27921540-4329-4015-9543-f0994f0b06a6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.159009 Sep 08 01:15:33.360760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 131/270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:33 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:33.722449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:33.723071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:33.729664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.730148 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.731274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.731964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.732442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.732868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.834883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:33.841696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:33.858735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.859232 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.859673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.860462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.860921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.861350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.907967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:33.921803 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7069910d-faf3-4ce1-ad24-bb41f8226956 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.203163 Sep 08 01:15:33.922630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 140/271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:33 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:33.954891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:33.955893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:33.969154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.969801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.970250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:33.971010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:33.971556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:33.972264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.034017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.049618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.049618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.049618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-461d925d-d2e7-4615-b36d-e15baa140516 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.222305 Sep 08 01:15:34.050166 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 132/272] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:33 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:34.055406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:34.056009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:34.063714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.064243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.064676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.065369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.065833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.066238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.184661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.198878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc7af4a8-63ac-4505-b0ca-7569470817e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.147377 Sep 08 01:15:34.204305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 133/273] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:34 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:34.210684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:34.216528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:34.225190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.238264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.238951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.239487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.240349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.241204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.241739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.255973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d44cff43-bc00-48c0-b546-d1e09a5046ed tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.303910 Sep 08 01:15:34.258577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 141/274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:33 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:34.377430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:34.378038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:34.384193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.384667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.385104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.385803 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.386254 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.386746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.414747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.422917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d82087b-7b7e-470d-b54c-fa31c9a36511 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.217323 Sep 08 01:15:34.423698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 134/275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:34 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:34.528448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:34.536721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-488f659e-9469-408b-a076-d26366fb6c5f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.162954 Sep 08 01:15:34.548582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 142/276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:34 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:34.951778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:34.952514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:34.959129 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.959680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.960208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:34.960965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:34.961504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:34.961987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.075698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:35.076484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:35.078870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=22 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:35.085802 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.086297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.086733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.087438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.087892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.088347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.118310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.126245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-545aa0ba-7b6a-4200-b2aa-34a994337f9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.179288 Sep 08 01:15:35.127191 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 135/277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:34 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:35.230123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:35.231554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:35.232908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.238126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.238626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.239096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.240008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.240553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.241237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.245107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.247564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.249188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e7543a05-44d5-4d56-9d46-3f9e06341a4a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.177706 Sep 08 01:15:35.260363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 143/278] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:35 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:35.288883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:35.289862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:35.306241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.306881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.307538 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.308275 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.308778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.319780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.335494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.352895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7394925d-5bf4-423b-89b3-aabb7b5d1c5a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.126772 Sep 08 01:15:35.353791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 136/279] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:35 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:35.446054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:35.446766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:35.453487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.453983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.454415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.455120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.455582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.456003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.610846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.627410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7228e752-2285-4ec0-91ff-146357ad5c71 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.185315 Sep 08 01:15:35.627999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 137/280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:35 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:35.633358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:35.633531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:35.660228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.661272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.661934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.662647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:35.663839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:35.664263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:35.681601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.691491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-66855517-f68a-4112-a7b0-4d780b5de5d1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.408473 Sep 08 01:15:35.692687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 144/281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:35 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:35.813714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:35.821504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f36700e6-52f0-4a55-96a7-b29309f16b89 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.192325 Sep 08 01:15:35.822077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 138/282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:35 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:36.150816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.151703 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.160490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.161162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.161603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.162533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.163156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.163529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.279622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.280828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.285429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:36.289750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.290736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.291603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.292636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.293399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.294042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.315003 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.323163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd0916e5-2cf0-4ffd-82ee-5361cffd4981 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.176344 Sep 08 01:15:36.323838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 145/283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:36.377891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.378879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.385345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.390351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.392674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.393643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.394095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.394516 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.473844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.475185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.483987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e8cd1eaf-8c84-4ca7-b257-fbfa4c96f51c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.109751 Sep 08 01:15:36.484554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.486174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.487381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-baf861a8-7d42-4b56-b175-e0d4268faba6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.213549 Sep 08 01:15:36.487944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 139/284] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:36.500227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 146/285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:36.653719 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.654324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.660559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.660974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.661404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.662100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.662547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.662970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.716174 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.716878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.724444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.724931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.725364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.726069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.726522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.726945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.743151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:36.815227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.823602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b17dd007-78d8-4c14-b400-0ba166db871f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.174107 Sep 08 01:15:36.839128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 140/286] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:36.846295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:36.846995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:36.853153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.853736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.854229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.855001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:36.855571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:36.856431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:36.882542 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=30 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:36.887721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:36.898208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-16c57708-12bd-417a-a700-3adb3764ae0e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.186905 Sep 08 01:15:36.900816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 147/287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:37.011426 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.021277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-79481f6d-bbde-45c6-9241-95c0a26e6740 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.178995 Sep 08 01:15:37.021872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 141/288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:36 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:37.347127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:37.347747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:37.354476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.355014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.355902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.356190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.356649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.357076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.504297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.508597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:37.509553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:37.513733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1c5fc1f6-3941-41da-9333-da2afef44110 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.170496 Sep 08 01:15:37.514348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 148/289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:37 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:37.517100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.517603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.518041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.518868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.519209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:37.519343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.519491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:37.519763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.525125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.525581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.526006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.526685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.527153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.527719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.591244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.600365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c28a44e-d22f-476d-9611-9ecedbb01aa6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.096366 Sep 08 01:15:37.601414 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 142/290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:37 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:37.673867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.682022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.683503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.684815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9fd6b91b-2d64-4f53-b401-b0cb1c7df98b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.169539 Sep 08 01:15:37.685364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 149/291] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:37 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:37.847378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:37.847984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:37.854090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.854569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.855001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.855702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.856162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.856588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.923045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:37.923766 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:37.929897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.930550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.930983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.931989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:37.932514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:37.932945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:37.990231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:37.998600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1d1ed36-2c86-4d8a-852c-fb7776787a61 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.155520 Sep 08 01:15:37.999177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 143/292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:37 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:38.046768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:38.047473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:38.053563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.054146 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.054648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.055337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.055781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.056224 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.071735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.079509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1538b8c7-c49c-4e1a-920a-bb204dd14bb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.160243 Sep 08 01:15:38.080282 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 150/293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:37 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:38.189937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.197487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce8247b7-abb2-4180-8b33-7415e114bd1a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.155587 Sep 08 01:15:38.198058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 144/294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:38 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:38.541409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:38.542049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:38.548966 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.549446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.549877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.550569 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.551023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.551442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.627380 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:38.628019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:38.634678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.635159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.636106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.636307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.637298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.637722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.686273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.694033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7ff91738-8158-4cdb-82b3-3efc1ccdd432 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.156523 Sep 08 01:15:38.694599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 151/295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:38 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:38.709460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.712091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:38.712740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:38.717685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c005bb07-93b5-4987-8d65-a841d27accde tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1240 microversion: 2.1 time: 0.094230 Sep 08 01:15:38.718192 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 145/296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:38 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:38.718774 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.719333 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.719798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.720670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:38.721157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:38.721631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:38.851481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.860466 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.861904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:38.863066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-96289995-9ecd-4176-94e1-70dce15d1f19 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.154881 Sep 08 01:15:38.863637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 152/297] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:38 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:39.022560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.023172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.029725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.030212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.030650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.031341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.031796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.032253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.036119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:39.102629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.104043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.111471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.112708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.113358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.114201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.114771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.115322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.180853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:39.189613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-489dce0b-c204-4705-9a28-141df17eda9b tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.170954 Sep 08 01:15:39.190193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 146/298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:39.220238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.220935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.226853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.227324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.227750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.228451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.228897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.229329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.258325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:39.266520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9d32b523-c280-412b-8aba-874773a7ef70 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.167746 Sep 08 01:15:39.267096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 153/299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:39.369074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:39.379850 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-da579059-adca-4350-b938-84485de20009 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.163483 Sep 08 01:15:39.380494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 147/300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:39.717887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.718594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.725034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.725535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.725963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.726645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.727088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.727501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.742228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.742847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.750074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.751036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.751657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.752870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.753618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.754051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.829880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:39.837807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e40abd0a-7112-4369-89d8-afa2043e8e19 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1296 microversion: 2.1 time: 0.100788 Sep 08 01:15:39.838447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 148/301] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:39.870408 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:39.878216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1113a57e-4fff-4890-8181-5301c2788567 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1367 microversion: 2.1 time: 0.165065 Sep 08 01:15:39.878785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 154/302] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:39.889486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:39.890116 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:39.891935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:39.897374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.897857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.898285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:39.898974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:39.899421 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:39.899872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.083281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.097789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.099322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.100565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-70e51a56-093d-409d-b839-26edc54f14c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.215953 Sep 08 01:15:40.101125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 149/303] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:39 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:40.212594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:40.213234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:40.219663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.220156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.220611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.221300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.221754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.222173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.293374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:40.294095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:40.309262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.309772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.310220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.310934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.311394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.311821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.364170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.372273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-41156de2-12c5-401d-9c8a-b8114fd9feb1 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.163527 Sep 08 01:15:40.373013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 155/304] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:40 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:40.403078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:40.403725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:40.405900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:40.411853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.412396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.412833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.413584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.414084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.414504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.447396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.455902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5ab28be8-e055-44df-a2bd-b21100245377 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.166924 Sep 08 01:15:40.456511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 150/305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:40 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:40.554330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.562654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-55137c5f-3927-4a14-b74c-d484209df364 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.163855 Sep 08 01:15:40.563220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 156/306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:40 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:40.862042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:40.863388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:40.872239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.872638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.873243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.873932 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.874375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.874796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.903799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:40.905165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:40.913459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.913949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.914384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.915089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:40.915542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:40.915968 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:40.947248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:40.956933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dccd6853-7661-4fa0-b551-ed5496e3c4cf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1296 microversion: 2.1 time: 0.098578 Sep 08 01:15:40.957845 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:40 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:41.125832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.127668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.128511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.134151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0777d1b7-46e4-4043-a2b2-9ccad6dd65f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1557 microversion: 2.1 time: 0.234816 Sep 08 01:15:41.134761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 157/308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:40 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1557 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:41.136022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.137247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.137682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.138378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.138829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.139252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.157327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.157743 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.163862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.164416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.164855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.165585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.166215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.166751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.248358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-560accdf-dde7-461f-a304-f9ecb49e996c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094794 Sep 08 01:15:41.248964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 158/309] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:15:41.280776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.289668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.291395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.293114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a9bf5253-7df0-4e67-8866-cf8f14f4635c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1743 microversion: 2.20 time: 0.169225 Sep 08 01:15:41.293975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 152/310] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:41.394894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.395625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.401593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.402129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.402854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.403684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.404150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.404573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.482167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.483411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.493144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.497306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.497306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.498423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.498423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.498707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.733797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.743600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c9674077-a5fc-4bea-a786-9c02564c4362 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.268357 Sep 08 01:15:41.756165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 153/311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:41.756165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.756165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.760739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.760739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.760739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.760739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.761139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.761139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.774691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.783957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f33574ec-3067-40a6-bbdf-2d9cbe58cec3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.392923 Sep 08 01:15:41.784576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 159/312] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:41.892023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:41.898435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.898935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.899402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.937485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:41.947040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-293fb04f-c61f-45e2-bd01-4ac152730a09 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.201056 Sep 08 01:15:41.947985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 154/313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:41.972183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Going to try to stop instance {{(pid=120715) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 01:15:41.981187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:41.982735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:41.990289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.990862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.991396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:41.992397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:41.992939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:41.993646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.045460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-25f4b9cc-edda-47ad-a076-b3ccf2b70bf8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action" status: 202 len: 0 microversion: 2.1 time: 0.158041 Sep 08 01:15:42.047233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 160/314] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:15:41 2022] POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:15:42.056585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:42.058309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:42.066260 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.067133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.067814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.068664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.069343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.069864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.071267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:42.080271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e39a1765-0be5-423b-9a10-6d14d7cf123c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1296 microversion: 2.1 time: 0.103687 Sep 08 01:15:42.128167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 155/315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:41 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1296 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:42.319640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:42.320273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:42.326578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.327072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.327574 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.328312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.328763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.329188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.404805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:42.415061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a975f930-1802-4e9f-b67f-acc1c6c7e0cc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.363023 Sep 08 01:15:42.420782 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:42 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:42.506785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:42.515614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:42.517084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:42.518290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0bd2a0ba-f34c-428b-a66d-3e107c63a2d9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1743 microversion: 2.20 time: 0.202621 Sep 08 01:15:42.518975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 156/317] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:42 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:42.673432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0def3b08-5561-4931-922e-84d954c7949e", "tag": "ea84e823-ad97-4efb-b4c3-42cdbf5d23df"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:42.685170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.686212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.686647 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.697769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] Creating event network-changed:ea84e823-ad97-4efb-b4c3-42cdbf5d23df for instance 0def3b08-5561-4931-922e-84d954c7949e on hv-cinder-84773 Sep 08 01:15:42.704988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-c84e36ff-40f9-4296-bbfa-f8e3128e88cb req-e0521d83-fc6b-4340-957a-ee7d9ce4b5a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040979 Sep 08 01:15:42.706058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 162/318] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:42.768809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:42.769341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:42.775172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.775647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.776078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.776790 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.777303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.777833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.807886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:42.809381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:42.817618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.818506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.819254 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:42.820404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:42.821995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:42.822711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.005580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.016695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-19cab8ee-1e18-42b6-b3ba-ab535243c1bf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.251621 Sep 08 01:15:43.017757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 157/319] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:42 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:43.022990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:43.023606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:43.031122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.032381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.033085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.034446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.034994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.035486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.039540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.041891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:43.050143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fabfd8b5-29e5-4435-8554-3dc0ce887256 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.246847 Sep 08 01:15:43.050972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 163/320] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:42 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:43.110846 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:43.111606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:43.119931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.120466 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.121145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.122246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.122797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.123307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.199233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.209090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e2a6257-e352-4dd5-9292-2ec8cfc82785 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1296 microversion: 2.1 time: 0.101994 Sep 08 01:15:43.209889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 164/321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:43 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1296 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:43.225777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.234529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-af2c86ad-2b0f-4f86-a517-7b89f86e9a2d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1314 microversion: 2.1 time: 0.215498 Sep 08 01:15:43.235193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:43 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:43.440941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:43.441738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:43.447684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.448190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.448627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.450091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.450559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.450980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.545977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:43.546588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:43.552588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.553080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.553925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.554195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:43.554639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:43.555090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:43.585776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.594431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-492a4ff2-dbbd-488e-8a56-af10fb060d07 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.157346 Sep 08 01:15:43.595202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 165/323] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:43 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:43.750460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.759797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.762174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:43.763456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7c2a8f9f-9bea-4ed5-a18c-8e00934b16e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1743 microversion: 2.20 time: 0.221876 Sep 08 01:15:43.764123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 159/324] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:43 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:44.039563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.040465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.048309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.048965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.049424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.050466 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.050898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.051350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.073864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.075012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.084380 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.085102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.085774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.086553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.087077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.087737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.224860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.233431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-06c20a8c-a859-465c-ace9-281567187d2d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.198137 Sep 08 01:15:44.248182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 166/325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:44.248182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "name": "network-vif-plugged", "status": "completed", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:44.248646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.252313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.252806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.253464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.256288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-20c1561a-f1b0-4025-9c6b-ac1ce3d26b18 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.186693 Sep 08 01:15:44.257145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 160/326] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:44.262933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.263573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.267538 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] Creating event network-vif-plugged:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:15:44.269641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.270129 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.270566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.271259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.271736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.272198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.273645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-708a79ac-eff3-4c58-9e2f-eecbe45e4514 req-218e618f-569e-4740-97f8-0528072d25bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038478 Sep 08 01:15:44.274362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 167/327] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:44.282273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.282978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.289664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.290149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.290590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.291294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.291748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.292231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.339330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.348010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ac078f99-56ef-4c1b-b99d-e75494f0091b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1304 microversion: 2.1 time: 0.089668 Sep 08 01:15:44.348601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 161/328] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:44.433683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.441606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5808ec7b-95a7-42e3-b6a8-a4c6adfa1d1e tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1499 microversion: 2.1 time: 0.163402 Sep 08 01:15:44.442176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 168/329] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1499 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:44.618641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.619246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.625564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.626046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.626508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.627197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.627667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.628075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.782546 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.790637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:44.791233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:44.795106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:44.798132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.798616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.799052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.799801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:44.800290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:44.800847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:44.801062 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f04e3970-9208-4749-9567-cf069a597f28 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.186348 Sep 08 01:15:44.802017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:44.938427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.946787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.948191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:44.950016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c32c3253-1abf-4e4e-92c7-a9e932139913 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1743 microversion: 2.20 time: 0.163190 Sep 08 01:15:44.950595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 169/331] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:44 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:45.038990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.039485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.046134 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.046613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.047049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.047731 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.048208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.048633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.073657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:15:45.147706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bb3e4fc8-b62b-4a35-b05b-c1d5ede14aaf tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 204 len: 0 microversion: 2.1 time: 0.112370 Sep 08 01:15:45.148388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 163/332] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:15:45 2022] DELETE /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:15:45.157783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.158414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.164741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.165214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.165641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.166320 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.166765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.167202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.258601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.259604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.266548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.267039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.267473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.268196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.268650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.269075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.304201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:45.313133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ebaef9c4-7b55-4f81-b6ec-c1cfcfa92483 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1505 microversion: 2.1 time: 0.160124 Sep 08 01:15:45.313940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 170/333] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:45.321183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.321795 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.328000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.328518 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.328955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.329645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.330099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.330529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.406942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:45.414735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7cce30a5-c65e-4483-8293-38642257892d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.160331 Sep 08 01:15:45.415375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 164/334] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:45.420620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.421567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.427399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.427954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.428502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.429467 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.429975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.430461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.470513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:45.481053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-18eb9350-4706-42f5-9c66-62d8db3dd062 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.165657 Sep 08 01:15:45.481653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 171/335] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:45.508669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:45.516668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c668a063-f312-4844-a2a7-2bfe54a7b191 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1304 microversion: 2.1 time: 0.100294 Sep 08 01:15:45.517230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:45.825623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.826271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.832403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.832899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.833336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.834030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.834486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.834913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.970867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:45.978850 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:45.979674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:45.982170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-979706a6-2953-4ac0-a8a1-4dce44893ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.161170 Sep 08 01:15:45.982955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 172/337] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:45.986894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.987688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.988148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:45.988982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:45.989437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:45.989859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.125338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.134150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.135612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.137042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-662504e0-27ed-419a-902e-05cb8b380f0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.161955 Sep 08 01:15:46.137601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 166/338] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:45 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:46.336570 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:46.337099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:46.345082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.345562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.345992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.346680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.347124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.347572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.439511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:46.440125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:46.446223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.446705 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.447138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.447828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.448307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.448794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.494481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.503592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-238904b5-c96e-42b2-871f-56247d61f0c7 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1505 microversion: 2.1 time: 0.170721 Sep 08 01:15:46.504558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 173/339] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:46 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:46.514215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:46.514974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:46.521288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.521905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.522352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.523051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.523505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.523935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.581984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.589882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bd9b8dd9-596f-4ca2-abc5-67ad027af610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.153928 Sep 08 01:15:46.590377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 167/340] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:46 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:46.595236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:46.595842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:46.601995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.602472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.602900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.603587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:46.604035 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:46.604489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:46.665007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.672824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:46.674233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ce4ed144-00a8-42f8-a254-9dfbfc68ebe7 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.164281 Sep 08 01:15:46.674775 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 174/341] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:46 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:46.680441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-02357e39-d3c0-4c82-9be2-4763e9952706 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1314 microversion: 2.1 time: 0.088898 Sep 08 01:15:46.681009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 168/342] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:46 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1314 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:47.005878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.006495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.016608 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.017228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.017789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.018692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.019263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.020053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.175376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.176782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.188815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.189600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.190182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.191072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.191677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.192290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.229122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.243269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3544fafb-6b29-471f-9237-5221dc5b84b8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.240649 Sep 08 01:15:47.244566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 175/343] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:47.458977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.468945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.470702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.472033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9d6c611b-402d-4ccc-9eac-331ad0cc468d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.308727 Sep 08 01:15:47.472743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 169/344] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:47.530265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.530986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.541367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.541857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.542292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.543123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.543487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.543899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.613815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.614430 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.622138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.623214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.623922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.625011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.625136 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.625535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.695126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.703326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4d0d2ccd-6672-4d63-8721-f90c65c8d0e4 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1505 microversion: 2.1 time: 0.177786 Sep 08 01:15:47.703904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 176/345] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:47.708978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.709576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.715769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.716482 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.716992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.717748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.718270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.718761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.856112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.866027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-09de4fc6-5a5e-4a9b-b602-1b24b32043ea tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.159362 Sep 08 01:15:47.866428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 177/346] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:47.872169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:47.872784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:47.879132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.879625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.880063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.880833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:47.881290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:47.881718 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:47.953173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:47.961807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6c282c60-5394-44b1-aa5c-db4113e07cfa tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1302 microversion: 2.1 time: 0.094208 Sep 08 01:15:47.962412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 178/347] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:48.082260 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:48.093740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9fd064a0-0f57-4bb5-a6ed-b1523c6ac349 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.483996 Sep 08 01:15:48.094317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 170/348] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:47 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:48.267314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:48.268042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:48.277280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.277819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.278215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.278932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.279389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.279855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.422696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:48.431005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4417ce63-34ae-41ba-a37c-c8428cef7fcc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.167911 Sep 08 01:15:48.431589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 179/349] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:48 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:48.499069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:48.499999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:48.505922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.506400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.506832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.507522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.507969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.508417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.729161 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:48.731015 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:48.746811 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.748708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.749323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.751304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.754073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.756298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.763826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:48.778952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:48.780436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:48.781829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f90f1085-0cc7-4a3a-9a0f-8ceea8238f27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.287226 Sep 08 01:15:48.782392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 171/350] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:48 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:48.889917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:48.890531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:48.909089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.911703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.912212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:48.913027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:48.913490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:48.913981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.175363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:49.191744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3df98710-4633-40e6-ad3c-429d794c5188 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.302099 Sep 08 01:15:49.193252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 172/351] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:48 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:49.199077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:49.200304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:49.209884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.210831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.211766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.212827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.214731 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.215563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.383547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:49.395206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c98aedf0-c117-4660-92de-0355d2237f5c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1505 microversion: 2.1 time: 0.671311 Sep 08 01:15:49.411012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 180/352] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:48 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1505 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:49.411012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:49.411012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:49.422378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.422992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.423296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.424173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.424749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.435967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.440995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:49.501639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:49.509981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5b289193-0d48-4682-8b24-72fe476fed96 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.314626 Sep 08 01:15:49.511154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 173/353] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:49 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:49.516616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:49.517540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:49.528776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.534005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.534756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.535728 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.536450 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.537104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.696023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:49.719962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d43fd3e9-b2a0-468b-9fc8-544bb8b782ab tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.322486 Sep 08 01:15:49.725974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 181/354] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:49 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:49.810550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:49.811229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:49.818306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.819107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.819905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.820878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.821700 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.822502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.842866 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:49.850898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9644758-9120-4e09-aa2a-c0cefffd6599 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.338006 Sep 08 01:15:49.860578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 174/355] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:49 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:49.880998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:49.910887 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:49.914402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:49.914885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:49.965850 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] Creating event network-changed:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:15:49.995325 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a5974f45-2799-48a4-b2bb-e787318c6aba req-59f2f8ce-1c80-452e-8895-9e010f8640d0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123327 Sep 08 01:15:49.996108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 175/356] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:50.007816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dccb51f-a617-41d2-bd73-b2d2844e372c", "name": "network-vif-deleted", "tag": "f5a8a140-01e0-44a0-a28b-db371a7406c5"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:50.024327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.024916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.025545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.038918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] Creating event network-vif-deleted:f5a8a140-01e0-44a0-a28b-db371a7406c5 for instance 4dccb51f-a617-41d2-bd73-b2d2844e372c on hv-cinder-84773 Sep 08 01:15:50.046774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a1e2f3bd-b5bb-4b88-9163-f401c7602401 req-ade00cc4-7749-4267-a1d6-1c7c58eb74d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044393 Sep 08 01:15:50.047720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 176/357] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:50.190986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.199745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.204917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.208085 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-22bc82dd-4a49-4338-92fa-374a3bfb8908 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.402079 Sep 08 01:15:50.213373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 182/358] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:49 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:50.247796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:50.249026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:50.279948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.284522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.285232 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.287829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.290083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.294671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.419447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac896548-c86b-4c3b-ae24-a97ceadfd1b2", "name": "network-vif-plugged", "status": "completed", "tag": "7a3b0f9f-81f3-465c-b3b6-fb90228f7f74"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:50.436923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.437590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.438177 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.467115 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] Creating event network-vif-plugged:7a3b0f9f-81f3-465c-b3b6-fb90228f7f74 for instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 on hv-cinder-84773 Sep 08 01:15:50.477674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-eb550a0f-b5a6-4723-854b-43bcf75c92e4 req-ea2a873f-ec26-4614-976b-5bea27389b26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061954 Sep 08 01:15:50.482725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 183/359] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:15:50.491265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:50.498120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:50.508066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.509667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.510383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.511741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.512417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.512918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.604509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.605134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.605574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.606027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lazy-loading 'fault' on Instance uuid 4dccb51f-a617-41d2-bd73-b2d2844e372c {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:15:50.616872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.655830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce39d5cb-a39e-435b-abb3-a2cad59091e2 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.421967 Sep 08 01:15:50.661192 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 177/360] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:50 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:50.674563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:50.675689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:50.682674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.684912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.685633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.686582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.687422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.688411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.729264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.741147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6da514db-3bf7-44df-bd9a-79e334f5bb7d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1304 microversion: 2.1 time: 0.256510 Sep 08 01:15:50.754957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 184/361] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:50 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1304 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:50.768776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:50.769390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:50.779504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.780319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.780914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.781813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.782421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.783061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.941735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.950861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-97bf301b-a08e-4aaf-9b59-5ace8a52d2d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.194495 Sep 08 01:15:50.951446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 185/362] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:50 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:50.964616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:50.964616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:50.964906 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:50.965115 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.965219 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.965821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.967075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:50.967747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:50.968413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:50.993598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-53be8960-10db-4eb9-84b8-41ba67164301 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.330203 Sep 08 01:15:50.994406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 178/363] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:50 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:51.131229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.141800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e87f866f-2cd2-4996-851d-932296fdf50b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.189322 Sep 08 01:15:51.142446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 186/364] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:50 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:51.241251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:51.242206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:51.249170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.250032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.250532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.251297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.251820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.252353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.259227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:51.412199 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.421488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.423094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.424262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f99c0aab-7893-445c-870b-92dbf69bd416 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.186975 Sep 08 01:15:51.440347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 179/365] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:51 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:51.704007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:51.704007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:51.737639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.738309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.738870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.739816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.740551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.741094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.781252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:51.782527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:51.799381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.801308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.802437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.803334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.803964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.804622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.851176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.851940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.852406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.852861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lazy-loading 'fault' on Instance uuid 4dccb51f-a617-41d2-bd73-b2d2844e372c {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:15:51.929135 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.938887 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-466cee62-8f4a-4c3d-9e89-7000f1b6f763 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 200 len: 1304 microversion: 2.1 time: 0.163989 Sep 08 01:15:51.947497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:51.952872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 180/366] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:51 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 1304 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:51.955428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4c67b1c1-359e-4af3-8617-454e71beb31d tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.271566 Sep 08 01:15:51.955992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 187/367] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:51 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:51.980772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:51.981392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:51.987555 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.988049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.988540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:51.989245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:51.989713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:51.990125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.020435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:52.021181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:52.033658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.035169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.036401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.037877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.038496 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.039562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.151216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.170159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cea5adba-e58e-4152-8fef-53b3b9f18a8f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.195171 Sep 08 01:15:52.172181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 181/368] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:51 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:52.176989 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:52.178256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:52.194579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.195996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.197480 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.199880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.205126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.205970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.311571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.324581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-50bd13ad-f778-4aff-baeb-230004c62809 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.308626 Sep 08 01:15:52.328784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 188/369] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:52 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:52.446992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.450898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:52.451771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:52.457706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3591a483-7f9f-4498-8984-fc7b7824cb7a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.285387 Sep 08 01:15:52.458284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.458946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.459079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 182/370] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:52 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:52.459717 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.460600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.461282 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.461929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.521309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "name": "network-vif-plugged", "status": "completed", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:52.544002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.544544 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.545017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.557495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] Creating event network-vif-plugged:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:15:52.563299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-dd337c17-db52-4eef-aa31-7405c1e8f52c req-c03608c3-3c01-49ff-ae9c-ac1745973bed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058821 Sep 08 01:15:52.563926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 183/371] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:52.641474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.650832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.652753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:52.654184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2b4a6b3b-371d-453b-8f79-1c891e7923a4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.208006 Sep 08 01:15:52.664583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 189/372] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:52 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:15:52.962700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:52.963392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 4dccb51f-a617-41d2-bd73-b2d2844e372c] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:52.970322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.970794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.971218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.971896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.972367 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.972788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.981094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:52.981799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:52.989006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.989494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.990482 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.990745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] HTTP exception thrown: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. Sep 08 01:15:52.990840 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:52.991135 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:52.991745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Request method failure captured: Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c HTTP/1.1 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIhALYINS0wxKH9EVgTUTNZSEH5tiKWklLewpJctK15HHBkM2r0glrQC8Mtotivz4vBjpMjfAQDes370U6oRjv1csPqV_VWHRb-BInrHoGyMITdv3tImQXQLjfBbTYh1kDMi0XqMJUvRdg8KQ24lNVoJIp82PFSt_jvRRoRNghqYUY Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 8263d46be0db47ce9191c099759cf0e9 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesActionsTest-841869264 Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:15:52.992156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8263d46be0db47ce9191c099759cf0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8263d46be0db47ce9191c099759cf0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8263d46be0db47ce9191c099759cf0e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8263d46be0db47ce9191c099759cf0e9"}]}] Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesActionsTest-841869264 Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8263d46be0db47ce9191c099759cf0e9 Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesActionsTest-841869264 Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesActionsTest-841869264-project Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: e5351a59a0294f59b6b26ddc22ba7ffa Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesActionsTest-841869264-project Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. Sep 08 01:15:52.993420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '4dccb51f-a617-41d2-bd73-b2d2844e372c'} Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:15:52.994183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. Sep 08 01:15:52.999369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:15:53.002753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Returning 404 to user: Instance 4dccb51f-a617-41d2-bd73-b2d2844e372c could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:15:53.002753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc39a890-1b1f-4393-a8db-76da652942ec tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c" status: 404 len: 111 microversion: 2.1 time: 0.035565 Sep 08 01:15:53.002753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 184/373] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:52 2022] GET /compute/v2.1/servers/4dccb51f-a617-41d2-bd73-b2d2844e372c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:15:53.063125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1744728935", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "networks": [{"uuid": "fa579fdb-88da-425f-b3f9-01e317248a84"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:53.130607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] validate_networks() for [('fa579fdb-88da-425f-b3f9-01e317248a84', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:15:53.180705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:53.191111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d73c981e-ae41-4e9f-9a00-46f513c55700 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1315 microversion: 2.1 time: 0.213789 Sep 08 01:15:53.191376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 190/374] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:52 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:53.196482 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:53.197560 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:53.204903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.205842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.206507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.207621 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.208297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.208903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.463305 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:53.474513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-816e70f5-1200-47c7-92cc-c8170416c187 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.281857 Sep 08 01:15:53.475456 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 191/375] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:53 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:53.480727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:53.481702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:53.489247 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.489869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.490429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.491376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.492009 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.492690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.678611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:15:53.679153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:15:53.679685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:15:53.680209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:15:53.680683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:15:53.697888 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.699253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.699788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.700799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.701877 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.702311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.711294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:53.719935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3efbaedf-3edd-480e-ade0-6d56eeab4794 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.243198 Sep 08 01:15:53.720544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 192/376] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:53 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:53.726877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:53.727177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Getting quotas for project 8263d46be0db47ce9191c099759cf0e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:15:53.727479 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:53.733302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Getting quotas for user e5351a59a0294f59b6b26ddc22ba7ffa and project 8263d46be0db47ce9191c099759cf0e9. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:15:53.734632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.735121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.735556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.736292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.737071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.737207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.748277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:15:53.751311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:15:53.813055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b9e59615-706d-4565-b9a1-d0c3c7201e48 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753954 Sep 08 01:15:53.813703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 185/377] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:15:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:15:53.818180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:53.818793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:53.826087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.826572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.827005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.827916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:53.828387 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:53.828821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:53.936209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:53.944748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-39ecae08-bb03-45e7-86c1-ac7147c8177c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.223183 Sep 08 01:15:53.945337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 193/378] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:53 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:53.951368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0d19269c-1c0e-424f-96ef-abab23a29036 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:53.951967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0d19269c-1c0e-424f-96ef-abab23a29036 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.010742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.011768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0d19269c-1c0e-424f-96ef-abab23a29036 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.019048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0d19269c-1c0e-424f-96ef-abab23a29036 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1214 microversion: 2.1 time: 0.072597 Sep 08 01:15:54.021942 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 194/379] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:53 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:54.022293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.023804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.024979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f025e177-f287-48da-a756-03489b2a5716 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.210360 Sep 08 01:15:54.039221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 186/380] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:53 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:54.213637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:54.214837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.230198 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.230869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.231552 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.232293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.232748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.233171 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.505998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.511244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:54.512833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.525954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9e7498fc-9e72-4781-975c-9f36008ddf2f tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1464 microversion: 2.1 time: 0.314862 Sep 08 01:15:54.528853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.529285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 195/381] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:54 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1464 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:54.530111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.530716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.531594 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.532518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.533103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.598723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:54.600176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.608943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.609760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.610471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.611468 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.614121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.614954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.660172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:15:54.755171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:54.763966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b172495e-1e5c-483d-bd56-6a0236b24094 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.264793 Sep 08 01:15:54.764903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 187/382] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:54 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:54.769715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:54.770343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.773358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:54.777784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.778476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.778920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.779609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.780083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.780544 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.795742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-44c1ff4d-a63f-4b62-a2cf-acaabde3e717 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 204 len: 0 microversion: 2.1 time: 0.201691 Sep 08 01:15:54.797145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 196/383] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:15:54 2022] DELETE /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:15:54.808830 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:54.809619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:54.820433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.821081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.821867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.822738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:54.823040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:54.825236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:54.854143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:54.991660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.005277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b3f75b41-4367-4a53-acfb-e27d75d601de tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.239287 Sep 08 01:15:55.006196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 188/384] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:54 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:55.010748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:55.012016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:55.020393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.021655 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.022297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.023349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.024012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.024655 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.046699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.057059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3ad8d857-61a9-48da-bce3-29d7e197c006 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1470 microversion: 2.1 time: 0.255731 Sep 08 01:15:55.060722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 197/385] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:54 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:55.070839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:55.072546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:55.083459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.083957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.084581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.085969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.088779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.090499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.163090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.171785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-93777914-191b-4a8b-9392-b9569278b966 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1218 microversion: 2.1 time: 0.108910 Sep 08 01:15:55.176647 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 198/386] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:55 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:55.188750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:55.189368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:55.203101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.203595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.204031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.204771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.205228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.205643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.255612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.266873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6fcb9cf4-e20f-443f-96b8-37ab85d871d9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.259695 Sep 08 01:15:55.267704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 189/387] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:55 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:55.367783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.380108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.381692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.382982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a222e491-3eb6-4d37-b2c0-2075dc675ec3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.204981 Sep 08 01:15:55.383808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 199/388] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:55 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:55.790313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:55.791503 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:55.799407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.799407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.799407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.800243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:55.800771 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:55.801411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:55.956569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:55.968030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-532be225-ce17-4b6e-a41c-f9059d129b5b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1358 microversion: 2.1 time: 0.181383 Sep 08 01:15:55.969299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 190/389] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:55 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:56.031378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.033650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:56.040655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.041142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.041583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.042888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.043550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.043990 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.086931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.088194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:56.100398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.101531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.102495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.103246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.103717 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.104169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.241214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.252758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-277f5de0-b0dc-4b39-99b1-56112f47641f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.225269 Sep 08 01:15:56.253936 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 200/390] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:56.261493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.262483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:56.267291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:56.277050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.279701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.280509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.281972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.282696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.283497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.316718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.326338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-80a5a5e9-5365-4c48-b8bd-97135e9dafd3 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1470 microversion: 2.1 time: 0.243397 Sep 08 01:15:56.332363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 191/391] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1470 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:56.338450 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.340309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:56.347390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.348108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.348721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.349616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.350052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.350482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.403936 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.423364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bf0dbbc0-8cca-4c39-a1ac-54c428a2aba0 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1210 microversion: 2.1 time: 0.166535 Sep 08 01:15:56.437758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 201/392] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1210 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:56.445722 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.446515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:56.456510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.456510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.457440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.458637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.459018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.459604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.609944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.632238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-144035aa-9c5f-4eba-893b-97d9d0d8152c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.297856 Sep 08 01:15:56.649878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 192/393] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:56.657772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "name": "network-vif-plugged", "status": "completed", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:56.669360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:56.669848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:56.670281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:56.683286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] Creating event network-vif-plugged:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:15:56.689805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.699813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-b65fd7a9-413d-4b48-82f7-aa282d52e186 req-c06e45f8-43d0-4a51-895d-148913c79248 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047063 Sep 08 01:15:56.700103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.701135 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 193/394] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:56.701760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:56.703052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f4f116a4-a85d-4435-94f6-9f2d52b1e298 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.264250 Sep 08 01:15:56.703693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 202/395] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:56.996648 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:56.997582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.004357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.004844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.005312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.005967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.009456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.010059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.218429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.228147 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-65089175-ab75-4154-af4e-99e6565cefa9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1549 microversion: 2.1 time: 0.237287 Sep 08 01:15:57.228730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 194/396] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:56 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1549 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:57.256579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.256579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.263585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.264074 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.264549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.265408 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.265866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.266295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.277085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.279293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.287710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.288220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.288655 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.289355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.289800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.290851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.434185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.447845 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9705cf75-5e80-4f24-a292-fc30bb929067 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1549 microversion: 2.1 time: 0.197899 Sep 08 01:15:57.449022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 203/397] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:57.457825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.458972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.467419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.469432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.470121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.471206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.471671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.472098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.481634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.491603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f693c1b1-50b9-4f01-a6e2-b7b988f40103 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.217876 Sep 08 01:15:57.491603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 195/398] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:57.498018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.498752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.505251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.505945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.506455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.507207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.507732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.508244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.596030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.608918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-85de72d6-eab8-483f-ba0d-a00a972da77a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1266 microversion: 2.1 time: 0.116133 Sep 08 01:15:57.609745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 196/399] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:57.620670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.625390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.626164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Searching by: {'deleted': False, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63'} {{(pid=120716) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 01:15:57.646737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.647205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.647642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.649712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.649943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.650367 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.684073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:57.694724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e89cbcae-b386-4b47-9b4d-794df730344c tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1470 microversion: 2.1 time: 0.240473 Sep 08 01:15:57.708157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 204/400] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1470 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:57.722402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:57.722947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:57.732773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.732773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.732773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.733230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:57.733785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:57.733991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:57.813963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.multi_cell_list [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120716) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 01:15:57.973306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:15:58.008819 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-de38ac79-5deb-4045-8256-40ccb5cf7ae6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.398082 Sep 08 01:15:58.009845 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 197/401] 10.222.0.42 () {58 vars in 1125 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers => generated 342 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:58.015299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:58.016613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:58.023835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.024375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.024820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.025534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.025985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.026482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.116847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.126809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f2046a66-de5e-4f31-9976-babbe0a2994c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.421489 Sep 08 01:15:58.141237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 205/402] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:57 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:58.150341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:58.152031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:58.172156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.174428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.174943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.177574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.181757 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.182281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.343978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.352915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.354393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.361277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9394bbdf-1de7-4c53-b874-5dedf7b60abd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.345175 Sep 08 01:15:58.373151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 198/403] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:58 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:58.468750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.477701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-645a1340-7799-4f3c-a8d3-43e0f4a21923 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1549 microversion: 2.1 time: 0.335023 Sep 08 01:15:58.478619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 206/404] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:58 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1549 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:58.515984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:58.516886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:58.529208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.531179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.531917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.532930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.534523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.535208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.633588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:58.634772 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:58.657901 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.658395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.667585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.668400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.669169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.669852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.797492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.808175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5d77d739-615f-4a31-9f73-3e8a7c69588e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.297127 Sep 08 01:15:58.808418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.809695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 199/405] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:58 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:15:58.819177 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ba5c87c4-452b-419a-a380-f2f04991e265 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1266 microversion: 2.1 time: 0.189799 Sep 08 01:15:58.819776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 207/406] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:58 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:58.831137 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:58.835063 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:58.844215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac896548-c86b-4c3b-ae24-a97ceadfd1b2", "name": "network-vif-deleted", "tag": "7a3b0f9f-81f3-465c-b3b6-fb90228f7f74"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:15:58.854031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.854779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.855508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.855640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.856059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.856543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.857462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:58.858124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:58.858923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:58.874176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] Creating event network-vif-deleted:7a3b0f9f-81f3-465c-b3b6-fb90228f7f74 for instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 on hv-cinder-84773 Sep 08 01:15:58.885233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-07431151-967a-4d8e-a9a6-ed01b2003ed5 req-88a36718-19ab-4236-825c-ef5f3ad35088 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053500 Sep 08 01:15:58.888111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 208/407] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:15:58.943114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:58.985958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-37be5f60-76b6-4071-86c0-db7172d3d568 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1428 microversion: 2.1 time: 0.174924 Sep 08 01:15:58.986549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 200/408] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:58 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1428 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:59.154619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:59.155665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:59.162917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.163393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.163822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.164546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.164993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.165553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.322705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:59.332886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-be06ad32-e337-4a3f-8689-b3a243736d98 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.182821 Sep 08 01:15:59.333748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 209/409] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:59 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:15:59.385558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:59.387175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:59.397134 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.397741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.398181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.398878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.399328 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.399753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.569349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:59.578286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:59.580919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:15:59.583201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-72b62bef-d399-46d1-94fe-3945bbc773e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.201929 Sep 08 01:15:59.584377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 201/410] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:15:59 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:15:59.833205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:59.834461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:59.840827 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.841568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.842527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.843429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.844050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.844742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.847308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:15:59.847922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:15:59.855754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.856525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.857135 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:15:59.858254 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:15:59.858861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:15:59.859485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.019022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.027950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7700093f-fb29-4f5d-b70f-ac86ff83f2ca tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1284 microversion: 2.1 time: 0.184500 Sep 08 01:16:00.040506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 202/411] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:59 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1284 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:00.050158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:00.051055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:00.057190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.057786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.058235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.058954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.059388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.060097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.097789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.098345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.098854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.099374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lazy-loading 'fault' on Instance uuid ac896548-c86b-4c3b-ae24-a97ceadfd1b2 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:16:00.217084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.227824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-273cd6f8-c36d-4ece-bcf2-3474af12731a tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1305 microversion: 2.1 time: 0.181538 Sep 08 01:16:00.238229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 203/412] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:00 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1305 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:00.264446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.272888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1146d0a1-9846-4afb-a44e-530c4bff38e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1367 microversion: 2.1 time: 0.443298 Sep 08 01:16:00.293786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 210/413] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:15:59 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1367 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:00.357226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:00.357913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:00.364056 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.364566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.364999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.365687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.366130 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.366732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.481465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7123e0c-bd2a-4a09-bdeb-f63015c0f611"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:00.483828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:00.495836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.496664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.497279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.498170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.499090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.499686 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.561087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.570657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-faa665e1-880c-4863-b607-7c841b62d5ce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.217649 Sep 08 01:16:00.571899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 204/414] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:00 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:00.610202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:00.610932 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:00.618291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.618973 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.619406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.620725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:00.621272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:00.621668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:00.817926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.832775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.836909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:00.839096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6db4370f-76d2-4dd7-963a-69edff8b6847 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.232499 Sep 08 01:16:00.840204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 205/415] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:00 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:01.051538 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.052194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.061168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.061672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.062197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.063172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.076706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.077506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.081221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ceac8d8c-f1bf-4559-99cb-aaaf6100afaa tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.603478 Sep 08 01:16:01.083514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 211/416] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:16:00 2022] POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:01.277077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.278389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.289442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.290362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.290994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.293010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.293679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.294143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.337852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:01.340730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.341429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.342787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.343458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lazy-loading 'fault' on Instance uuid ac896548-c86b-4c3b-ae24-a97ceadfd1b2 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:16:01.349297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa6d03f8-c066-42ea-a10b-c4d1ee7c3e1d tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.301346 Sep 08 01:16:01.351149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:01.364378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.365650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.374413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.374895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.375327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.376085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.376564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.377026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.427939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9851332c4fdf4874bb3e860f0035fd4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5deaa920a59448268a4151c845bb7851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:01.437313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d81c1878-ce6f-4b7a-bc6a-f5d66685bc26 tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 200 len: 1305 microversion: 2.1 time: 0.173423 Sep 08 01:16:01.452531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 212/418] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:01.523138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:01.535442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a53bbfbf-9146-4903-952e-0d2cc58a22bd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1561 microversion: 2.1 time: 0.182994 Sep 08 01:16:01.536231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 207/419] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:01.571504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.572065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.590636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.597954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.598929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.599904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.601038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.601149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.601819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.604804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.607971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.608504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.608934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.610138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.611237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.611835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:01.612188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.781310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5022bd92-53ef-4066-baef-3677290fdc1c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223209 Sep 08 01:16:01.782567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 213/420] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:01.832314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:01.845250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-17815245-ac01-4d80-b3e4-aee20c4578c3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.251223 Sep 08 01:16:01.845998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 208/421] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:01.866103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:01.866744 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:01.872948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.873443 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.873853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:01.874532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:01.874981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:01.875402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.374446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:02.375043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:02.383287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.384332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.386104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.387199 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.387839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.388339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.457638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:02.467859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:02.469404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:02.470599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-32997e36-620e-465b-95e8-329244bc89db tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1738 microversion: 2.20 time: 0.608390 Sep 08 01:16:02.471156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 214/422] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:01 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:02.484546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:02.486154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] [instance: ac896548-c86b-4c3b-ae24-a97ceadfd1b2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:02.492751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.493432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.494058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.494752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.495944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.496521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.511088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] HTTP exception thrown: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Request method failure captured: Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 HTTP/1.1 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIjFnf_bqsH17U21o_vw9Caq7_IbWtAD7RUKsijCF-RRJpL8K2-abYHP0DVyq9viiFGpdoTgCg0o0lcVri9G90s0dP09Gk8i-8lFYQV9lAzlB5NZPEB_SRg100fr53rihBAoWRAv1d_qEvVD54-HKr8f5NdgKRKR54jy-faGylE_Zs Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 5deaa920a59448268a4151c845bb7851 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-974368501 Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:16:02.513986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5deaa920a59448268a4151c845bb7851"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5deaa920a59448268a4151c845bb7851"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5deaa920a59448268a4151c845bb7851", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5deaa920a59448268a4151c845bb7851"}]}] Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-974368501 Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 5deaa920a59448268a4151c845bb7851 Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-974368501 Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-974368501-project Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 9851332c4fdf4874bb3e860f0035fd4b Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-974368501-project Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. Sep 08 01:16:02.515470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'ac896548-c86b-4c3b-ae24-a97ceadfd1b2'} Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:16:02.516341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. Sep 08 01:16:02.517672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:16:02.519587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] Returning 404 to user: Instance ac896548-c86b-4c3b-ae24-a97ceadfd1b2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:16:02.520475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5501c6ae-01c2-4949-bb6f-52560e1641ae tempest-VolumesNegativeTest-974368501 tempest-VolumesNegativeTest-974368501-project] 10.222.0.42 "GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2" status: 404 len: 111 microversion: 2.1 time: 0.048218 Sep 08 01:16:02.524305 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 215/423] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:02 2022] GET /compute/v2.1/servers/ac896548-c86b-4c3b-ae24-a97ceadfd1b2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:16:02.535527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:02.547160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-00bbe520-df2e-4395-8515-2d423597a84a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.177251 Sep 08 01:16:02.547667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 209/424] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:02 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:02.691904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3de20e69-113a-422a-b4be-0f57e8d8421d", "tag": "d715975e-fd16-45ee-a9f9-136ec344a2fd"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:02.703733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.704362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.705017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.719878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] Creating event network-changed:d715975e-fd16-45ee-a9f9-136ec344a2fd for instance 3de20e69-113a-422a-b4be-0f57e8d8421d on hv-cinder-84773 Sep 08 01:16:02.726304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-e5376922-3432-4ebf-8ef1-5e219ae64252 req-70ce03d9-976b-4648-aa19-4b2cb4a373cf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039567 Sep 08 01:16:02.727423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 216/425] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:02.870933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:02.871468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:02.877465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.878197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.878796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:02.879668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:02.880122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:02.880748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:03.125937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:03.135883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f63377bd-60e8-45fe-be2e-67291b16be3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.270905 Sep 08 01:16:03.137264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 210/426] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:02 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:03.499913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:03.500708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:03.506998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:03.507484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:03.507918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:03.509210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:03.509828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:03.510250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:03.570410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:03.570937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:03.578154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:03.578639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:03.579069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:03.579765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:03.580271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:03.580660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:03.713673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:03.722366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:03.723970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:03.725443 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b3212236-6e6e-47c6-bb10-509a9521fc89 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1720 microversion: 2.20 time: 0.231506 Sep 08 01:16:03.726532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 217/427] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:03 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:03.743033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:03.764330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:03.772612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0f97b798-47e1-424a-bc92-857aeadec39f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.206109 Sep 08 01:16:03.773450 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 211/428] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:03 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:04.160904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:04.161529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:04.163641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:04.170810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.171310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.171749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.172682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.173501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.173950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.327870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:04.341950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-831b11bd-0fc8-454d-9323-bbfe9e95c230 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.184840 Sep 08 01:16:04.342651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 218/429] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:04 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:04.751390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:04.752079 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:04.752715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:04.763098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.763328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.763471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.763613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.764033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.764517 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.770056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.770625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.771068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.779169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] Creating event network-changed:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:16:04.784519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-9b7124ed-614e-4704-86a5-b7065e64c3f8 req-6a67610a-207c-4643-a0ea-89ab833af473 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036786 Sep 08 01:16:04.785618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 212/430] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:04.798269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:04.799196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:04.806892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.807652 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.808261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.809104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:04.809824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:04.810409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:04.952598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:04.963762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:04.965578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:04.966794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bf8d044e-0a6e-428a-ae51-878baa520823 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1720 microversion: 2.20 time: 0.218862 Sep 08 01:16:04.980170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 219/431] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:04 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:04.981056 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:04.990980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d5e8080d-5783-4cbd-8016-9dc269bedc42 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.197605 Sep 08 01:16:04.991596 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 213/432] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:04 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:05.367808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:05.368834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:05.377344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:05.377806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:05.378458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:05.379538 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:05.380220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:05.381070 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:05.535417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:05.544844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-409c81ff-e2bc-42fa-a727-d9a959f129f6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.181780 Sep 08 01:16:05.545473 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 220/433] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:05 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:05.996593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:05.997198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:06.003994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.004510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.004943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.005669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.006120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.006545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.019608 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:06.020278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:06.026561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.027042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.027475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.028211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.028673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.029682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.149491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:06.155019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:06.165230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:06.166956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:06.168463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4471662f-f445-4790-aa8c-9c4aa9043e6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1720 microversion: 2.20 time: 0.175747 Sep 08 01:16:06.169894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:06.180602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 214/434] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:05 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:06.186897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c784b279-5238-4729-bebe-05878609b25b tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.171298 Sep 08 01:16:06.187418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 221/435] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:06 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:06.203137 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "name": "network-vif-unplugged", "status": "completed", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:06.212960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.213753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.214185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.225252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] Creating event network-vif-unplugged:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:16:06.230225 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-715022c0-f33f-4270-a79b-5e267b93bb9c req-5b48e749-2709-4632-ba3d-5a2cf423204d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031169 Sep 08 01:16:06.231057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 215/436] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:06.568790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:06.569402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:06.575301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.575901 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.576400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.577103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:06.577558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:06.577989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:06.717231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:06.726192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e5da265e-bd03-401d-8763-ac3e4f50e292 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.161185 Sep 08 01:16:06.727000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 222/437] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:06 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:07.195438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:07.196148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:07.204001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.204831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.206361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.207550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.208245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.208899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.210903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:07.212439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:07.221710 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.221710 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.221710 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.223836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.224797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.225462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.381799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:07.385143 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:07.391383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dece56eb-8000-4d96-9cb5-5d6fbda8c7e6 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.184478 Sep 08 01:16:07.392313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 223/438] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:07 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:07.395202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:07.396683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:07.397880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fd50aa0a-d6ce-4737-ae15-6df3e105b42b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1723 microversion: 2.20 time: 0.207191 Sep 08 01:16:07.398424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 216/439] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:07 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:07.422705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11bfb25e-edeb-447b-b451-7e6febf161c5"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:07.425168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:07.431237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.431723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.432177 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.432873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.433324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.433745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.754918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:07.755671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:07.761177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:07.763179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.763837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.764514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.765217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:07.765948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:07.766608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:07.812353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4eb7c285-ffa2-4a1d-8ef3-c0fc3c419fcd tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.393263 Sep 08 01:16:07.813280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 224/440] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 8 01:16:07 2022] POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 188 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:16:07.932266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:07.942885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6fd43834-40bd-494e-bfc6-0e56ed1b14e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.192184 Sep 08 01:16:07.943469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 217/441] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:07 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:07.991448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:07.992474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:07.999809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.000336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.000798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.001542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.001993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.002517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.049419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120715) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 01:16:08.129850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f4564413-85c2-483c-b179-627b4561d470 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/action" status: 202 len: 0 microversion: 2.20 time: 0.142698 Sep 08 01:16:08.131071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 225/442] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 8 01:16:07 2022] POST /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:16:08.141174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:08.142207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:08.149997 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.151217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.152034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.153314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.154554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.155187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.378172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:08.390050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:08.392075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:08.393930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-18014838-3cc9-42a9-9128-bd6ca6df7310 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1749 microversion: 2.20 time: 0.258174 Sep 08 01:16:08.395067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 218/443] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:08 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:08.421301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:08.425042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:08.435450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.440731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.441394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.442371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.443086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.444213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.629489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:08.639018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-726cf0d3-d7ae-4d3e-bb2a-e59f3f8f4429 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.223822 Sep 08 01:16:08.640362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 226/444] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:08 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:08.966518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:08.967338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:08.976523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.982782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.986154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:08.988379 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:08.988864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:08.990569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.243868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:09.267234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f24568c0-7a1a-45bd-a0a4-d6ca50715b3d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.304491 Sep 08 01:16:09.280568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 219/445] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:08 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:09.425119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:09.425671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:09.432258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.432732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.433163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.433851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.434297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.434715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.583021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:09.586728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:09.601290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:09.602989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:09.604236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd62c541-fe00-4155-9563-980fa3b2b809 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1749 microversion: 2.20 time: 0.183079 Sep 08 01:16:09.604734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 227/446] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:09 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1749 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:09.661828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:09.662555 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:09.668835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.669404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.670628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.671457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.671907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.672366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.805156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:09.813180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d4bf8e82-7f8d-4674-8ae7-fca3c916dc08 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.155277 Sep 08 01:16:09.813743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 220/447] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:09 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:09.930844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:09.931451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:09.938842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.939325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.939761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:09.940487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:09.940938 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:09.941358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.077966 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:10.086084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7dcc2a3f-4595-430f-b2f0-99c9f626f251 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1595 microversion: 2.1 time: 0.159014 Sep 08 01:16:10.086653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 228/448] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:09 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1595 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:10.291565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:10.292253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:10.299025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.299523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.299929 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.300662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.301118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.301546 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.474380 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:10.486804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a160756-3b9d-40f0-9afb-f956b2ec7791 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.199315 Sep 08 01:16:10.488170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 221/449] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:10 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:10.577797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de20e69-113a-422a-b4be-0f57e8d8421d", "name": "network-vif-plugged", "status": "completed", "tag": "d715975e-fd16-45ee-a9f9-136ec344a2fd"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:10.588734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.589436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.590389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.602724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] Creating event network-vif-plugged:d715975e-fd16-45ee-a9f9-136ec344a2fd for instance 3de20e69-113a-422a-b4be-0f57e8d8421d on hv-cinder-84773 Sep 08 01:16:10.609019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9e96f0cd-6794-47a1-9900-c14f021af5f1 req-f2b82236-be73-4040-873c-b31d95f1d6a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035348 Sep 08 01:16:10.609662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 229/450] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:10.631661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:10.632770 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:10.643502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.644182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.644939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.646303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.647057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.647649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.750950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-843917967", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "networks": [{"uuid": "7ebb863f-f0f4-4943-8831-11422a5db3a1"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:10.857971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] validate_networks() for [('7ebb863f-f0f4-4943-8831-11422a5db3a1', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:16:10.877047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:10.889177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:10.890968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:10.893344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6a9994e8-2660-4b80-a00e-6aee489ce40e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1751 microversion: 2.20 time: 0.266322 Sep 08 01:16:10.894039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 222/451] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:10 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:10.899188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:10.900093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:10.906598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.907931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.908484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:10.909250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:10.909944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:10.910432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.313483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:11.321557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e6e7a8c6-ba86-4e0b-9d6c-e9291e11864c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.426110 Sep 08 01:16:11.322158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 223/452] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:10 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:11.511096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:11.511701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:11.518254 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.518736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.519172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.519861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.520364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.520788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.653127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:11.661774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bb419720-d443-4f7e-9d84-f375f10171b3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.154835 Sep 08 01:16:11.662504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 224/453] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:11 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:11.860971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:16:11.861438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:16:11.861854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:16:11.862264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:16:11.862674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:16:11.871415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.871890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.872923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.873844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.874300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.874721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.892336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Getting quotas for project 93477e5edb38498ba32feb52519ba584. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:16:11.896607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Getting quotas for user 336e7f07cd7d461c8257995a772ac1f0 and project 93477e5edb38498ba32feb52519ba584. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:16:11.907669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:16:11.910121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:16:11.921459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:11.922064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:11.928107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.928618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.929045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.930006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:11.930677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:11.931259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:11.964677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ca597702-8a74-41d6-8319-abee835cbc09 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219384 Sep 08 01:16:11.971470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 230/454] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:16:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:16:11.977053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e5619cbe-e71e-4932-90d9-4c14ef1bbbf4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:11.977856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e5619cbe-e71e-4932-90d9-4c14ef1bbbf4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:12.067959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e5619cbe-e71e-4932-90d9-4c14ef1bbbf4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.078890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e5619cbe-e71e-4932-90d9-4c14ef1bbbf4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1218 microversion: 2.1 time: 0.105725 Sep 08 01:16:12.092688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 231/455] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:11 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:12.137671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.149727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.151575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.153101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-33d14c9f-497a-4212-8c3f-239980ba73c6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.235670 Sep 08 01:16:12.153813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 225/456] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:11 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:12.346770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:12.347534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:12.353962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:12.354708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:12.355205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:12.356007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:12.356546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:12.357905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:12.555952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.564410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5bd5a8c1-0a53-494c-96d2-2c541efaa192 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.222178 Sep 08 01:16:12.564981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 232/457] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:12 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:12.686567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:12.687175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:12.694158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:12.694645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:12.695078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:12.695766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:12.696240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:12.696838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:12.814229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:12.827265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:12.828049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:12.828653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:12.843028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] Creating event network-changed:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:16:12.854732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-8bcdf847-b0ab-4b16-85fc-060129f913e2 req-98deef90-0c1b-4948-b721-1f1af50d5868 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045206 Sep 08 01:16:12.858065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 233/458] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:12.892625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:12.902820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1f6fc636-cc89-4008-822c-9ac6beb5ebde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1725 microversion: 2.1 time: 0.220916 Sep 08 01:16:12.904533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 226/459] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:12 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:13.103887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:13.104621 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:13.111528 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.112281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.112724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.113590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.114215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.114647 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.180243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:13.186364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:13.187906 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:13.193874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8f600cf9-1b48-423f-9444-46630779173a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1270 microversion: 2.1 time: 0.089457 Sep 08 01:16:13.194882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 234/460] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:13 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:13.205667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.207526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.208264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.209846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.210449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.211297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.363638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:13.373773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:13.375570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:13.376830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6d729918-382d-4684-a5b5-293f728bc8fa tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.201621 Sep 08 01:16:13.377397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 227/461] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:13 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:13.588417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:13.589450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:13.595667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.596180 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.596807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.597498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.598103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.598684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.930436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:13.931367 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:13.949550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.954238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.954911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:13.955975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:13.956708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:13.957313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.050245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.066134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-371f556a-8d33-4fb9-863e-7cbbd15580aa tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1314 microversion: 2.1 time: 0.481648 Sep 08 01:16:14.069107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 235/462] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:13 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:14.220339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:14.221242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:14.227110 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.229953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.232450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.238266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.238630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c19733b8-ae6a-4ab4-b0eb-8cfb1dbd5217 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1702 microversion: 2.1 time: 0.312797 Sep 08 01:16:14.239038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.239521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.240018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.240340 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 228/463] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:13 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1702 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:14.266121 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:14.272196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.272812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.274234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.357857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Going to try to start instance {{(pid=120716) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 01:16:14.377122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.386776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07efdc0c-e6c4-4cb6-98ac-de3735bc62ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1270 microversion: 2.1 time: 0.173136 Sep 08 01:16:14.387708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 236/464] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:14 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1270 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:14.407891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:14.408768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:14.409966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6ac05300-a284-4ab6-bd82-5a9cc185aebf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action" status: 202 len: 0 microversion: 2.1 time: 0.148651 Sep 08 01:16:14.410578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 229/465] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:16:14 2022] POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:16:14.423256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:14.423655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.424199 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.425062 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:14.425371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.426092 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.426530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.427216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.431702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.432238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.432898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.433611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.434046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.434465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.565090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.570221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.573674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.575101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:14.577200 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9ad1ea9b-b94c-479c-825d-c2fe27255f7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.175431 Sep 08 01:16:14.577759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 237/466] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:14 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:14.579468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5343a2da-dd81-42b7-8e0e-d4f9e641b6e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.162755 Sep 08 01:16:14.580222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 230/467] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:14 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:14.582448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-629112098"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:14.583142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:14.588921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.589399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.589829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.590503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:14.590952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:14.592326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:14.845742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.network.security_group_api [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Adding security group 904631b4-5ade-41f3-99fe-358cbeaad7e7 to port 3cb46279-f82a-410c-b844-66fe328c5c39 Sep 08 01:16:15.093571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:15.094314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:15.101068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.101712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.102247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.103406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.103612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.104155 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.108996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:15.314500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:15.322596 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-94af2638-2a89-4b22-933a-2b544428fa50 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1498 microversion: 2.1 time: 0.233776 Sep 08 01:16:15.323178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 231/468] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:15 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1498 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:15.411429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:15.412464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:15.420487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.420992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.421520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.422399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.423051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.423635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.527144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:15.535388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-63b662b5-b22a-4188-a3b0-595ea500a400 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1276 microversion: 2.1 time: 0.128053 Sep 08 01:16:15.536846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 232/469] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:15 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:15.627527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:15.628649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:15.642198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.642733 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.643460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.645383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.646009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.647171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.931299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c659d97c-8698-4a5c-9c2f-b11db01ac42c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action" status: 202 len: 0 microversion: 2.1 time: 1.352488 Sep 08 01:16:15.932205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 238/470] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:16:14 2022] POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:16:15.938643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:15.939483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:15.943077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:15.949267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.950688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.951406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.952453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:15.953216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:15.953891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:15.968560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:15.982556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:15.985088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:15.999434 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4301a9f6-e493-4dc8-9530-cefaaa7f6836 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.400029 Sep 08 01:16:16.005881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 233/471] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:15 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:16.022952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:16.024883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:16.047729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.048247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.050385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.051107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.051567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.051985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.389632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:16.399810 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:16.401612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-71a2f147-7873-4aad-b650-54dd61d02290 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.468223 Sep 08 01:16:16.407534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 239/472] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:15 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:16.410821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-12025a97-c1ca-40f3-acb1-efdef0db5d1b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1759 microversion: 2.1 time: 0.403701 Sep 08 01:16:16.411455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 234/473] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:16 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1759 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:16.425243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:16.438584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:16.444307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:16.460501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.462526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.464303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.470190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.470967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.471551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.490628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.491206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.491714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.529634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:16:16.547066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] Creating event network-changed:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:16:16.574889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-f4d8ad19-2029-47b5-9855-6d105e68b5be req-644000ff-49c4-492d-aee5-fac0eb33aa8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135112 Sep 08 01:16:16.577371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 240/474] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:16.592783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:16.595954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:16.611766 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.615958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.616625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.617690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.620506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.621144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.680031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:16.685717 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b8cabbc2-7dc5-4396-89ec-2469e5651951 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 204 len: 0 microversion: 2.1 time: 0.263911 Sep 08 01:16:16.686889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 235/475] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:16:16 2022] DELETE /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:16:16.697812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:16.699104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:16.707711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.708656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.709536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.712258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:16.713055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:16.713666 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:16.951186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:16.962534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-acf6132d-8e03-4372-b357-19e843eef27a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.379307 Sep 08 01:16:16.964363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 241/476] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:16 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:17.032172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:17.033037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:17.039384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.040081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.040906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.045046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.045726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.046321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.094001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:17.102782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e313c435-ff65-4c6c-a9de-42bc6d730006 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.410842 Sep 08 01:16:17.105691 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 236/477] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:16 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:17.218425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd1f622-0e3c-40ee-a8d1-4768c456e8f2", "tag": "615bdb45-f330-4435-9115-4359c278c980"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:17.232366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.233266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.233892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.247610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] Creating event network-changed:615bdb45-f330-4435-9115-4359c278c980 for instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 on hv-cinder-84773 Sep 08 01:16:17.255714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-499f80c8-8af3-44ef-86ef-0e36d6e59111 req-db6ef856-008c-40c2-84c0-45b84d6b3558 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041135 Sep 08 01:16:17.256954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 237/478] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:17.273958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:17.283126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:17.285678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:17.286878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-57e63157-c645-40a2-968c-871bd746a47e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.259851 Sep 08 01:16:17.287583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 242/479] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:17 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:17.434169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:17.436325 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:17.444756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.445838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.446607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.447894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.449058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.449758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.592197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:17.600552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52366d08-bf78-4c71-80f6-686c221b9440 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.171381 Sep 08 01:16:17.601345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 238/480] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:17 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:17.988953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:17.989497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:17.996107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.996625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.997076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:17.997797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:17.998259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:17.998690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.127696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:18.128351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:18.135372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.136151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.136603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.137461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.138492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.139425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.144650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.159396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-00cab1f8-9362-4d15-bbe1-28230cd53454 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.174264 Sep 08 01:16:18.161203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 243/481] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:17 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:18.305399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.314784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f17a9c4b-3ad3-49d0-bf10-7dcf1ea51fab tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.190922 Sep 08 01:16:18.315365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 239/482] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:18 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:18.317557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:18.318411 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:18.325549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.326042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.326640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.327344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.327799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.328251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.485708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.498004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.499442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.500655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-011ff6eb-da83-454e-9866-0fa3d2b5ef21 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.188405 Sep 08 01:16:18.501231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 244/483] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:18 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:18.624271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:18.625587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:18.631832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.632541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.636563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.637366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:18.638092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:18.639004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:18.784790 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:18.793475 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-140780bb-e447-4b26-a8a3-8ff43b9eb1c2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.173344 Sep 08 01:16:18.794641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:18 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:19.182863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:19.183619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:19.191110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.191588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.192057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.192772 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.193225 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.193688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.332298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.337748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:19.339082 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:19.341574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-574142f1-7730-4a6e-b660-213e9bfab1f4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.161718 Sep 08 01:16:19.346149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.346940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.347552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.348207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 245/485] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:19 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:19.348781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.349394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.349993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.495403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.503803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-026d3264-089a-4990-a2a4-2492a477a42f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.169896 Sep 08 01:16:19.504418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 241/486] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:19 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:19.525773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:19.526518 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:19.532804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.533285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.533721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.534423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.534875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.535296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.681766 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.692455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.694136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.697964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-21c112a0-7779-4fc1-b0eb-c50ec3e3df9a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.175979 Sep 08 01:16:19.698949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 246/487] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:19 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:19.818392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:19.818991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:19.825006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.826288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.826767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.827617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:19.828303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:19.828776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:19.979485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:19.989195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-54bcc70f-a424-4669-b7b8-a270cb5cbf6f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.174643 Sep 08 01:16:19.989757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 242/488] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:19 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:20.374062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:20.374687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:20.381277 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.381763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.382197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.382947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.383577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.384366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.526911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:20.527913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:20.531975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:20.535837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.536601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.537217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.538100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.538719 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.539306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.542496 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ae9ab0b-0b64-4e2f-b234-49759a954897 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.173470 Sep 08 01:16:20.543307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 247/489] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:20 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:20.681656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:20.689689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-362f36c6-2298-48eb-92ef-12d76cc7da57 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.166651 Sep 08 01:16:20.690262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 243/490] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:20 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:20.725602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:20.726406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:20.734266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.735168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.735717 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.736515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:20.737071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:20.737568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:20.753375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:20.877879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:20.887090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:20.889069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:20.890546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b3e60998-2d2a-4874-9933-86b73d8f1cb8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.169267 Sep 08 01:16:20.891289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 248/491] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:20 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:21.014043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:21.014834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:21.021152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.021635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.022074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.022766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.023214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.023633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.164978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:21.173780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a9b36092-74ed-43bf-b559-a30684f02e3c tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.164609 Sep 08 01:16:21.174553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 244/492] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:21 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:21.566514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:21.567202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:21.573489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.573961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.574392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.575137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.575636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.576061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.713429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:21.714109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:21.717552 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:21.726240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb7d152a-3c78-4424-9615-172151667ce2 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.163770 Sep 08 01:16:21.728005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.728195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 249/493] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:21 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:21.728698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.729197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.730103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.730616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.731119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.871757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:21.881161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7fd9a10c-fda6-4316-bab6-1dd48f31597c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.172282 Sep 08 01:16:21.885737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 245/494] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:21 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:21.916893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:21.917627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:21.920081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:21.937100 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.937594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.938053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:21.938744 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:21.939197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:21.939629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.079301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:22.081528 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=8 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:22.091410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:22.092903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:22.094193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c43d4777-d7c9-4569-b738-b61943d9d057 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.181311 Sep 08 01:16:22.095273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 250/495] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:21 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:22.196846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:22.197445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:22.204076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.204588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.205027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.205708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.206163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.206589 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.342785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:22.346633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:22.351719 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2bb5124e-ddce-4eb4-8253-09c9a0f21348 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.158673 Sep 08 01:16:22.352560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 246/496] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:22 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:22.750395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:22.751032 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:22.757502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.757978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.758412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.759356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.759804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.760409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.898214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:22.904846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:22.905458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:22.906116 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4f691c3a-013e-4944-bcda-9deac2560e19 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.160576 Sep 08 01:16:22.906981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 251/497] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:22 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:22.914584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.915255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.920686 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:22.921470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:22.921920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:22.922355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.072854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:23.081738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b372724a-e348-439b-805d-bd2c1a0e9e0a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.180918 Sep 08 01:16:23.082329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 247/498] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:22 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:23.119475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:23.120105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:23.127369 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.127865 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.128328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.129036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.129491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.129918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.275437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:23.284651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:23.286082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:23.287258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6db16b28-6b12-4f94-968c-a3feeabb24ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.171719 Sep 08 01:16:23.287818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 252/499] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:23 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:23.377833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:23.379102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:23.385711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.386204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.386639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.387344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.388174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.388520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.538572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:23.547924 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-87e2f40f-ab84-4ae8-8f51-0dc342bde2e7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.174840 Sep 08 01:16:23.548723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 248/500] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:23 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:23.928029 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:23.928753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:23.935902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.936495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.936999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:23.937783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:23.938332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:23.938840 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.074457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.083759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4c9e9599-ba52-490b-a258-1afd6848b1c5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.159517 Sep 08 01:16:24.084745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 253/501] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:23 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:24.104202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:24.104811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:24.111749 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.112284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.112724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.113468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.113922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.114344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.263937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.272158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-40d6a253-07b0-4fe2-a10a-34fa624698f9 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.171752 Sep 08 01:16:24.273020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 249/502] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:24 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:24.313998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:24.314609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:24.321057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.321630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.322071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.322772 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.323227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.323680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.471483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.480420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.483072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.484280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dbed231f-4628-46b0-aeeb-bc1981ee1016 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.175180 Sep 08 01:16:24.485030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 254/503] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:24 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:24.571124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:24.571779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:24.578700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.579178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.579615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.580343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:24.580793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:24.581214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:24.719312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:24.728105 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52426f92-5ae9-4414-af3c-29f7d90c536f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.160684 Sep 08 01:16:24.740678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 250/504] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:24 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:25.106879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:25.107516 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:25.114066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.114555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.114991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.115692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.116155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.116600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.255511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.264314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-508dc5f8-ab94-440e-90c1-6181f2e79f33 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.161287 Sep 08 01:16:25.265218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 255/505] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:25 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:25.295782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:25.296427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:25.302819 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.303293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.303723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.304440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.304897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.305319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.439384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.447032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ecc19506-aceb-4e65-b18f-4e6a71a4a744 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.155946 Sep 08 01:16:25.447592 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 251/506] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:25 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:25.511143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:25.511746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:25.518530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.519027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.519460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.520188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.520648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.521375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.666140 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.675884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.677354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.678547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-648911e2-841c-4a15-a2df-b7da5c32716c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.171660 Sep 08 01:16:25.679112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 256/507] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:25 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:25.754260 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:25.754966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:25.761354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.761832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.762946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.763817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:25.764213 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:25.764683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:25.901415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:25.910880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b315ccc6-38f1-4af4-a055-9f3ab8d48035 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.160949 Sep 08 01:16:25.911550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 252/508] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:25 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:26.293993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:26.295760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:26.302441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.302929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.303365 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.304075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.304562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.304989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.443812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:26.452729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-db169ea4-b69a-48e8-8c39-4b7ea792a6e4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.168452 Sep 08 01:16:26.453324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 257/509] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:26 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:26.471240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:26.472008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:26.480284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.480851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.481980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.482971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.483517 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.484005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.626750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:26.636442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-46932d80-cd54-4d75-bdfa-bceb7cba72dc tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.170570 Sep 08 01:16:26.637026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 253/510] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:26 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:26.703798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:26.704539 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:26.710822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.711462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.712158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.712963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.713522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.714049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.849441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:26.858521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:26.860000 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:26.861214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-87c03e07-4ed1-4fc8-aa9f-4d0d9d673e3d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.161696 Sep 08 01:16:26.861992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 258/511] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:26 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:26.937738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:26.938347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:26.945090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.945707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.946258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:26.947065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:26.947622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:26.948172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.079513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:27.087705 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c1ad2f56-a806-40be-9126-c1207c3c8256 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.156762 Sep 08 01:16:27.088305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 254/512] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:26 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:27.478027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:27.478627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:27.486028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.486505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.486932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.487610 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.488054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.488500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.620267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:27.628222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-77e17811-3a01-4ae0-b2cb-288a78ad0b73 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.153916 Sep 08 01:16:27.628726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 259/513] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:27 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:27.659351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:27.659952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:27.666290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.666761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.667186 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.667857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.668344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.669533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.799001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:27.806550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-36271f33-8be6-4036-8983-c59fa4a8e40c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.151030 Sep 08 01:16:27.807115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 255/514] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:27 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:27.887863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:27.888410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:27.894191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.894656 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.895083 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:27.895750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:27.896242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:27.896656 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.022905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.031439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.032908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.034061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a239710c-b856-441a-a15a-bd6f276ade37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.150433 Sep 08 01:16:28.034620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 260/515] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:27 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:28.111403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:28.112015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:28.118040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.118545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.118966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.119651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.120106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.120558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.254039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.264698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a3bbe783-6b07-4878-ba60-4d782acc3ca1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1711 microversion: 2.1 time: 0.157152 Sep 08 01:16:28.265472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 256/516] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:28 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:28.650906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:28.651521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:28.658133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.658617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.659080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.659756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.660252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.660680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.791872 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.800474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2e257210-60b8-4e9c-838c-75a9cbb2edf5 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.153534 Sep 08 01:16:28.801067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 261/517] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:28 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:28.831251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:28.831857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:28.838339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.838815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.839246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.839933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:28.840470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:28.841441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:28.973340 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:28.981799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d5dee62c-2ff0-4c92-a8d9-da89dc29d2a3 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.153812 Sep 08 01:16:28.982370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 257/518] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:28 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:29.058860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:29.059989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:29.066019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.066508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.066949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.067643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.068099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.068563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.200994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:29.214493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:29.216272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:29.217962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-821ae621-c0fd-4736-8fbc-584a6e1289ea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.162944 Sep 08 01:16:29.218628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 262/519] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:29 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:29.288946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:29.294900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:29.302654 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.303277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.303758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.304492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.304947 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.305427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.485391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:29.493696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f096b467-e21f-4769-a9cb-dec18d3a91c1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1715 microversion: 2.1 time: 0.209213 Sep 08 01:16:29.494269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 258/520] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:29 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:29.705785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:29.706326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:29.712947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.713367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.713804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.714504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.714957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.715446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.738812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7bdef7bc-b1f9-4e14-ad71-147ee3e925cd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/ips" status: 200 len: 150 microversion: 2.1 time: 0.036903 Sep 08 01:16:29.739378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 263/521] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:16:29 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:29.824101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:29.825463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:29.831714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.832240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.832699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.833427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:29.833903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:29.834348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:29.977077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:29.986350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-52b0df88-d5a7-4662-93a2-87fa7cf88508 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.166148 Sep 08 01:16:29.992360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 259/522] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:29 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:30.014399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:30.015245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:30.026183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:30.026699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:30.027089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:30.027788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:30.029276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:30.030162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:30.246386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:30.248570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:30.255551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:30.256180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:30.256706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:30.257853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:30.258644 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:30.259594 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:30.264157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:30.275056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ea450521-1ccf-48df-9883-da5fd642c49c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.273624 Sep 08 01:16:30.276321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 264/523] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:30 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:30.439445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:30.448086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:30.449558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:30.451653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d84c912d-97e8-4c93-9606-3b5455cca62a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.209169 Sep 08 01:16:30.452240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 260/524] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:30 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:31.011699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:31.013761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:31.020926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.021842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.022520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.023477 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.024190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.024842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.042323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:31.156829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324ab12c-2ea4-49db-a0df-6e7972588546"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:31.160396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:31.168297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.169530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.169971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.170908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.171457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.172319 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.365658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:31.374816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4a21213f-d57d-4d20-9088-dce265111d82 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.367756 Sep 08 01:16:31.375407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 265/525] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:31 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:31.380456 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:31.381253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:31.399108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.400360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.403880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.405297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.406070 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.406679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.545003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-57d17760-9f87-421e-b7db-19bfd4046c59 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393392 Sep 08 01:16:31.551581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 261/526] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:16:31 2022] POST /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:31.557292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:31.558064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:31.565812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.566720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.567242 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.568010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.568915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.569418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.573981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:31.648820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:31.659440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d13be4c-f18e-43e7-a13c-ac4d63036a4c tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1504 microversion: 2.1 time: 0.282708 Sep 08 01:16:31.664520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 266/527] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:31 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:31.916856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3de20e69-113a-422a-b4be-0f57e8d8421d", "name": "network-vif-deleted", "tag": "d715975e-fd16-45ee-a9f9-136ec344a2fd"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:31.930544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:31.931296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:31.932080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:31.945382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] Creating event network-vif-deleted:d715975e-fd16-45ee-a9f9-136ec344a2fd for instance 3de20e69-113a-422a-b4be-0f57e8d8421d on hv-cinder-84773 Sep 08 01:16:31.951976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-25ff79e4-e574-49a2-9dbe-60eafecfd8d4 req-75b49c5d-2500-4932-8f1c-8929b5b6643f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039733 Sep 08 01:16:31.952696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 267/528] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:31.975111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:31.985389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:31.986846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:31.988061 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3079e46e-4d30-43d9-bf87-cc89a8469854 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.435198 Sep 08 01:16:31.988663 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 262/529] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:31 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:32.400633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:32.401327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:32.409848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:32.410339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:32.410787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:32.411533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:32.411959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:32.412428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:32.576413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:32.589268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2a9a8b1b-5d7d-4124-a5b8-965094de23b4 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.193352 Sep 08 01:16:32.591401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 268/530] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:32 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:32.690786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:32.691643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:32.705767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:32.706263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:32.706835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:32.707548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:32.708006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:32.708478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:32.748536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:32.749011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:32.749476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:32.749914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lazy-loading 'fault' on Instance uuid 3de20e69-113a-422a-b4be-0f57e8d8421d {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:16:32.795744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:32.803316 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6b48ac31-0350-438b-b335-78d08aa8264a tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1304 microversion: 2.1 time: 0.117516 Sep 08 01:16:32.803879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 263/531] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:32 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:33.015562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:33.016188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:33.022148 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.022645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.023071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.023749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.024220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.024640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.154407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:33.163232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:33.164700 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:33.165848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a1bf26ca-60a5-441b-97ed-10a04a94fa35 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.155057 Sep 08 01:16:33.166402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 269/532] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:33 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:33.620122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:33.620754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:33.627556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.628069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.628539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.629234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.629684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.630113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.774036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:33.782701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4bf9379-0e1f-4285-9a13-25e4d8d18821 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.166439 Sep 08 01:16:33.783483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 264/533] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:33 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:33.829528 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:33.830372 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:33.836821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.837304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.837740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.838420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.838871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.839326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.870652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:33.871083 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:33.871593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:33.872048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lazy-loading 'fault' on Instance uuid 3de20e69-113a-422a-b4be-0f57e8d8421d {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:16:33.916575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5351a59a0294f59b6b26ddc22ba7ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8263d46be0db47ce9191c099759cf0e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:33.924627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-72ff28d0-228d-4be0-8e11-e6e87f45145f tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 200 len: 1304 microversion: 2.1 time: 0.098882 Sep 08 01:16:33.925201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 270/534] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:33 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:34.193631 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:34.194297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:34.200649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.201300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.201758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.202478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.202952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.203375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.348934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:34.358843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:34.360396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:34.361567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d386c47-c6ab-41f1-a99e-ee86ec23e60e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.172009 Sep 08 01:16:34.362312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 265/535] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:34 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:34.805714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:34.806336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:34.813524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.814319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.814760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.815463 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.815923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.816380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.947799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:34.949147 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] [instance: 3de20e69-113a-422a-b4be-0f57e8d8421d] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:34.956863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.957444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.957959 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.958897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:34.959411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:34.960043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:34.976418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] HTTP exception thrown: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Request method failure captured: Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d HTTP/1.1 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIhALYINS0wxKH9EVgTUTNZSEH5tiKWklLewpJctK15HHBkM2r0glrQC8Mtotivz4vBjpMjfAQDes370U6oRjv1csPqV_VWHRb-BInrHoGyMITdv3tImQXQLjfBbTYh1kDMi0XqMJUvRdg8KQ24lNVoJIp82PFSt_jvRRoRNghqYUY Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 8263d46be0db47ce9191c099759cf0e9 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesActionsTest-841869264 Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:16:34.978322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8263d46be0db47ce9191c099759cf0e9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8263d46be0db47ce9191c099759cf0e9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8263d46be0db47ce9191c099759cf0e9", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8263d46be0db47ce9191c099759cf0e9"}]}] Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesActionsTest-841869264 Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8263d46be0db47ce9191c099759cf0e9 Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesActionsTest-841869264 Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesActionsTest-841869264-project Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: e5351a59a0294f59b6b26ddc22ba7ffa Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesActionsTest-841869264-project Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. Sep 08 01:16:34.979871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '3de20e69-113a-422a-b4be-0f57e8d8421d'} Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:16:34.980759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. Sep 08 01:16:34.982516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:16:34.984777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] Returning 404 to user: Instance 3de20e69-113a-422a-b4be-0f57e8d8421d could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:16:34.986009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cbf2fcd4-9fe4-47bc-985a-c5bca0a158e2 tempest-VolumesActionsTest-841869264 tempest-VolumesActionsTest-841869264-project] 10.222.0.42 "GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d" status: 404 len: 111 microversion: 2.1 time: 0.042208 Sep 08 01:16:34.986573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 266/536] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:34 2022] GET /compute/v2.1/servers/3de20e69-113a-422a-b4be-0f57e8d8421d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:16:35.248422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:35.254111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f17242f9-e3f5-4ecf-8ea0-f3c9faaa6044 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.452237 Sep 08 01:16:35.254684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 271/537] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:34 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:35.389787 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:35.390473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:35.398821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:35.399436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:35.399963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:35.402193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:35.402193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:35.402193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:35.550442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:35.563123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:35.564592 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:35.565755 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d21e403-9915-4870-a05b-c1d9c7745259 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.181772 Sep 08 01:16:35.566640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 267/538] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:35 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:36.279213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:36.279865 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:36.286776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:36.287276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:36.287728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:36.288488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:36.288976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:36.289400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:36.416962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:36.424478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f34b109f-16c1-402e-afd5-98281702eba7 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.149940 Sep 08 01:16:36.425040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 272/539] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:36 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:36.591309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:36.591862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:36.598447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:36.598920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:36.599352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:36.600033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:36.600501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:36.600926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:36.734506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:36.744162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:36.745758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:36.747967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4bc977ec-d63f-4b7e-a346-bc8d81ea9df8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.160723 Sep 08 01:16:36.748576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 268/540] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:36 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:37.447124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:37.447727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:37.454455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:37.454926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:37.455352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:37.456038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:37.456512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:37.456932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:37.595314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:37.602873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f6809caa-d245-4fe2-8e7f-8e1ae8fe8144 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.160142 Sep 08 01:16:37.603428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 273/541] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:37 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:37.774964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:37.775580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:37.782113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:37.782614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:37.783042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:37.783745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:37.784225 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:37.784654 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:37.930677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:37.941665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:37.943104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:37.944305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-acdd09ab-935d-4e1b-bc92-2b40993b6af5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.173221 Sep 08 01:16:37.958673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 269/542] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:37 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:38.633362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:38.634185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:38.641740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:38.642226 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:38.642697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:38.643453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:38.643932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:38.644426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:38.774516 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:38.784917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-335ac155-622b-4f26-aa31-85edccb73d49 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.155792 Sep 08 01:16:38.785636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 274/543] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:38 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:38.974231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:38.974769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:38.983223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:38.983716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:38.984184 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:38.984884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:38.985331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:38.985751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:39.123100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:39.131687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:39.133142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:39.134551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa0a3b82-fef8-4cd8-91ee-9875fd95c455 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.165393 Sep 08 01:16:39.135122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 270/544] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:38 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:39.808618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:39.810280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:39.816754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:39.817234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:39.817664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:39.818332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:39.818779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:39.819197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:39.967180 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:39.975875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f7842d7f-a968-4fdd-bb03-6dd627447e0a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.170993 Sep 08 01:16:39.988529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 275/545] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:39 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:40.159584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:40.160468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:40.174229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:40.174919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:40.175483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:40.179677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:40.180755 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:40.182370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:40.361095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:40.370887 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:40.372956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:40.374537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-299f5355-4d9c-48fc-bf46-4841ccdaae43 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.219218 Sep 08 01:16:40.375617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 271/546] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:40 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:40.973093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd1f622-0e3c-40ee-a8d1-4768c456e8f2", "name": "network-vif-plugged", "status": "completed", "tag": "615bdb45-f330-4435-9115-4359c278c980"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:40.985196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:40.985960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:40.986562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:41.004494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] Creating event network-vif-plugged:615bdb45-f330-4435-9115-4359c278c980 for instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 on hv-cinder-84773 Sep 08 01:16:41.005642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:41.006388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:41.010971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-fd2ddde2-8d66-4a47-8729-4fdfc283cdbb req-873f5ceb-5b53-429a-a907-a143c30985b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041890 Sep 08 01:16:41.011989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 276/547] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:41.039447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:41.045394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:41.045939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:41.049151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:41.052597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:41.053314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:41.245506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:41.256718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c24c1981-fc4a-4366-90f0-1151b6b16afc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.255500 Sep 08 01:16:41.273101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 272/548] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:40 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:41.405436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:41.408948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:41.422093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:41.423035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:41.425699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:41.426674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:41.427342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:41.429910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:41.437961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05ee53a8-f222-4e16-9d5e-e496ef2e695a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: .version_select at 0x7fe9c9b0a940>, body: {"keypair": {"name": "tempest-keypair-1746750676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6fAiItXgnsqPec0Zaj8lciE0GVkCSXcyd558uTH1pupvc7Y6QLoqxbuywLYb7t+unWelyeJ5gBK2Hs99D5LVDBLFEk/Qe/JSXdD81fxJOkp+DaItgRp2KsxbpJW1BtGQ=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:41.474736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-05ee53a8-f222-4e16-9d5e-e496ef2e695a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:16:41.489680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-05ee53a8-f222-4e16-9d5e-e496ef2e695a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:16:41.533578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05ee53a8-f222-4e16-9d5e-e496ef2e695a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099893 Sep 08 01:16:41.534191 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 273/549] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:16:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:16:41.607271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:41.625179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:41.627383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:41.629283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cb27a491-ed09-4b1b-a30a-7e0fd8280b7c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.228916 Sep 08 01:16:41.630403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 277/550] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:41 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:42.284171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:42.286656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:42.299645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:42.300637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:42.301399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:42.302753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:42.303558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:42.304305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:42.491204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:42.506284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e5dbb276-b2da-490d-9b36-ea8ec148e8da tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1318 microversion: 2.1 time: 0.227472 Sep 08 01:16:42.526975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 274/551] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:42 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:42.662712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:42.664083 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:42.677801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:42.678329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:42.680498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:42.681800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:42.684314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:42.684997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:43.097950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:43.123994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:43.127250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:43.128868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-146ab7d7-55a4-416e-a031-87787f783c23 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.472029 Sep 08 01:16:43.132176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 278/552] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:42 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:43.392124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-251062465", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e9407ec-0cf4-40eb-abcb-b44e26ace243"}], "security_groups": [{"name": "tempest-securitygroup--861087317"}], "key_name": "tempest-keypair-1746750676", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:43.511500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] validate_networks() for [('9e9407ec-0cf4-40eb-abcb-b44e26ace243', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:16:43.534995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:43.536049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:43.542467 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:43.543919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:43.544754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:43.545825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:43.546484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:43.546913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:43.739510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:43.753693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e8588570-239c-4bee-b586-e326b80d45d0 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1507 microversion: 2.1 time: 0.222453 Sep 08 01:16:43.754636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 279/553] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:43 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:44.019068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:16:44.019650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:16:44.020244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:16:44.020763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:16:44.021320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:16:44.032905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:44.033466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:44.034200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:44.035789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:44.036283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:44.036721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:44.051213 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:44.057587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:16:44.063399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:16:44.077005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:16:44.079483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:16:44.145282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-07078581-64f6-44df-b4cf-a8452468f024 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.756965 Sep 08 01:16:44.146900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 275/554] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:16:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:16:44.155449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:44.156525 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:44.160270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-beda74fd-62f9-4b64-918c-1b7a07129902 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:44.161961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-beda74fd-62f9-4b64-918c-1b7a07129902 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:44.177581 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:44.188908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:44.189636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:44.190561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:44.191196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:44.191793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:44.240217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-beda74fd-62f9-4b64-918c-1b7a07129902 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:44.250267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-beda74fd-62f9-4b64-918c-1b7a07129902 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1241 microversion: 2.1 time: 0.094584 Sep 08 01:16:44.251862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 276/555] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:44 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:44.423399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:44.439245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:44.440753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:44.442213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-36596181-2a9e-45f6-8566-8801699983b8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.291443 Sep 08 01:16:44.456837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 280/556] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:44 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:45.210188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "name": "network-vif-plugged", "status": "completed", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:45.227264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:45.228396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:45.229546 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:45.247328 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] Creating event network-vif-plugged:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:16:45.254967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-1a43471b-ca4a-4853-809c-94e0a1dab0b3 req-5292d91c-4190-4bd5-9fbb-cf5906824551 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050839 Sep 08 01:16:45.255906 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 277/557] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:45.274994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:45.276211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:45.283973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:45.284912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:45.285641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:45.286848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:45.287693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:45.288555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:45.383524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:45.396927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e48cfecd-6782-4650-957f-4d933a32ae6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1293 microversion: 2.1 time: 0.125927 Sep 08 01:16:45.410576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 281/558] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:45 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1293 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:45.469358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:45.470406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:45.478746 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:45.479602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:45.480096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:45.481292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:45.482069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:45.482710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:45.643365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:45.654226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:45.655737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:45.656983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-82e86532-8ad6-4234-b81c-1800c10843e5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.192808 Sep 08 01:16:45.657558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 278/559] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:45 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:46.434630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:46.436420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:46.446679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=87 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:46.448777 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:46.450451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:46.451247 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:46.452416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:46.453627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:46.456123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:46.591018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:46.600880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4810dc18-841a-440b-a166-7d3ae749c951 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1293 microversion: 2.1 time: 0.178557 Sep 08 01:16:46.602076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 282/560] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:46 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:46.683372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:46.684835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:46.692607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:46.693384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:46.694020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:46.695067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:46.695704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:46.696176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:46.848949 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:46.859466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:46.860921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:46.862315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4dae46ce-ca09-4150-93f5-51c937dbb5f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.183372 Sep 08 01:16:46.862905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 279/561] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:46 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:47.636615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:47.641480 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:47.655252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:47.657086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:47.658428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:47.664866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:47.665443 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:47.665972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:47.676595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:47.771914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:47.783680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-27af34df-e370-4865-91b6-2cbf4552c6ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1311 microversion: 2.1 time: 0.155698 Sep 08 01:16:47.792034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 283/562] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:47 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:47.889035 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:47.890441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:47.898750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:47.900195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:47.901330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:47.903948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:47.905064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:47.905792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:48.158636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:48.169526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:48.171489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:48.173014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-118f581a-cac7-4f74-a543-e66545806235 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.289863 Sep 08 01:16:48.189049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 280/563] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:47 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:48.811851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:48.813902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:48.828783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:48.829944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:48.831051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:48.832349 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:48.833194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:48.834048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:48.990121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:48.998355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a378f3b-9e4d-4a73-929c-c0ce358a2fe9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.194269 Sep 08 01:16:48.998923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 284/564] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:48 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:49.200818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:49.201424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:49.207708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:49.208222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:49.208667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:49.209370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:49.210031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:49.210461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:49.454406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:49.463845 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:49.465716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:49.467075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1ce77eca-ca64-4e06-9f0e-f3abacc81e8c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.270253 Sep 08 01:16:49.481228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 281/565] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:49 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:49.871657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707afd55-651c-49f6-9e30-7121f95a33dd", "tag": "34fff18a-0060-4b00-9710-133c7f049719"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:49.891089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:49.891888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:49.893063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:49.907760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] Creating event network-changed:34fff18a-0060-4b00-9710-133c7f049719 for instance 707afd55-651c-49f6-9e30-7121f95a33dd on hv-cinder-84773 Sep 08 01:16:49.914057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a1c32243-a994-4348-811e-20ce73a5c6e6 req-b010b700-8aa0-43e7-bbb3-002b385b81e4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046678 Sep 08 01:16:49.921651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 285/566] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:16:50.024474 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:50.025117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:50.034011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:50.034867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:50.035305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:50.036037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:50.036774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:50.037228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:50.058087 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:50.269642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:50.280962 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ba16c3b1-b58f-47ca-a7f6-0b196a94d81a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.262085 Sep 08 01:16:50.281935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 282/567] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:50 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:50.495212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:50.496644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:50.502869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:50.503678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:50.504248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:50.505017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:50.505954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:50.506390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:50.658507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:50.671175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:50.673011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:50.674279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-352e7bf5-f1cd-45bd-99fe-88343341552a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.183525 Sep 08 01:16:50.675427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 286/568] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:50 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:51.304601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:51.305210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:51.312825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:51.313308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:51.313742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:51.314637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:51.315152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:51.315738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:51.448621 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:51.457909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a772b4cf-443f-48cd-ac51-c43b6c07caca tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.157089 Sep 08 01:16:51.458484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 283/569] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:51 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:51.701440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:51.702049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:51.708580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:51.709064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:51.709500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:51.710200 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:51.710650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:51.711080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:51.849674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:51.858867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:51.860355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:51.861814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-66645be2-e3c2-448c-9e20-cc1a8deee2eb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.164863 Sep 08 01:16:51.862345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 287/570] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:51 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:52.481399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:52.482033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:52.490135 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:52.490611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:52.491077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:52.491833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:52.492512 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:52.492949 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:52.640282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:52.649073 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2fa91b06-c1a7-4d00-b3ec-0e0fd08011d5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.172195 Sep 08 01:16:52.651874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 284/571] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:52 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:52.895403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:52.896002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:52.902714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:52.903229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:52.903708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:52.904426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:52.904918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:52.905378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:53.058343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:53.067915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:53.069523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:53.070709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-31c9b567-015b-44d2-b2bb-d23dd26cfbb3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.179426 Sep 08 01:16:53.088402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 288/572] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:52 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:53.674162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:53.674955 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:53.681451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:53.681936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:53.682365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:53.689808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:53.690552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:53.691025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:53.829079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:53.837033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f7bfcf03-af2a-4c37-addf-322562d1196f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.166859 Sep 08 01:16:53.837602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 285/573] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:53 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:54.100547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:54.102080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:54.110985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:54.111649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:54.112274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:54.113142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:54.113831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:54.114410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:54.278210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:54.287897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:54.289623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:54.290998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-429803ec-0d30-4c7a-a614-699006f41670 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.194935 Sep 08 01:16:54.291690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 289/574] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:54 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:54.861022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:54.861758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:54.863685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:54.864588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=12 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:16:54.872162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:54.872662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:54.873100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:54.873797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:54.874250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:54.874672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:55.020858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:55.029976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-71603907-4a60-4bab-bc9d-5c43bdf0ca6a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.172746 Sep 08 01:16:55.030579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 286/575] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:54 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:55.317400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:55.318169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:55.326185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:55.326668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:55.327108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:55.328004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:55.328631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:55.329140 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:55.475011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:55.484708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:55.486186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:55.487347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52e02d6a-7e94-450a-bba8-3d4e39e46b27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.174506 Sep 08 01:16:55.487904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 290/576] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:55 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:56.061980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:56.062773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:56.071975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.072383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.073050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.073812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.074716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.075573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.198450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:16:56.205790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:56.212129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.212625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.213380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.214262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.216057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.216774 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.264692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:56.281990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-701d8537-21dc-4e35-9dcb-164971a0f44e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.231390 Sep 08 01:16:56.288665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 287/577] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:56 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:56.315353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-38411bf3-4289-4ab1-b830-7b44da55bccf tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action" status: 202 len: 0 microversion: 2.1 time: 0.122295 Sep 08 01:16:56.319274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 291/578] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:16:56 2022] POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:16:56.324729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:56.325407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:56.332156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.332677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.333110 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.333808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.334298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.334724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.514053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:56.515219 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:56.522888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.523681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.524371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.525427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:56.526122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:56.526648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:56.562660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:56.571363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-619aa4ae-6956-4a0a-b532-33622403c071 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1751 microversion: 2.1 time: 0.250762 Sep 08 01:16:56.577510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 288/579] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:56 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1751 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:56.736725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:56.749863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:56.751342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:56.752586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-38a2e6af-b7ec-43ac-8af4-d0e2c33e7877 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.242877 Sep 08 01:16:56.756180 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 292/580] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:56 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:57.305677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:57.306899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:57.319722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.320617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.323378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.325770 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.326277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.327070 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.492714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:57.501202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1674863-245f-434f-a4ad-c3d29d0c887e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.199594 Sep 08 01:16:57.501776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 289/581] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:57 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:57.600704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:57.601235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:57.609358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.609962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.610410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.611103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.611559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.611986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.767817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:57.779639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:57.780261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:57.782681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f371d05d-ea05-4888-a6da-64ba79fa2cb7 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.185734 Sep 08 01:16:57.783251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 293/582] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:57 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:16:57.786759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.787248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.787827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.788377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:57.788828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:57.789246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:57.972441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:57.982810 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:57.984302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:57.985496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c9a344f7-224b-4ad8-9c23-8cabc26ca0f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.210769 Sep 08 01:16:57.986054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 290/583] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:57 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:16:58.524604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:58.525208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:58.532256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:58.532748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:58.533186 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:58.533875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:58.534327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:58.534748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:58.681810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:58.689970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-669e5614-c2f1-4518-963f-2350f67bbc1a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.169239 Sep 08 01:16:58.690530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 294/584] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:58 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:58.806829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:58.807453 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:58.814562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:58.815043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:58.815469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:58.816185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:58.816842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:58.817259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:58.973951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:58.983029 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8af9436e-6986-4ec1-8a92-e53b0bf7566f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.180046 Sep 08 01:16:58.983598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 291/585] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:58 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:16:59.014494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:59.015096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:59.021219 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:59.021696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:59.022133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:59.022868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:59.023268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:59.023694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:59.165519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:59.174559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:59.176353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:59.177539 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd9db72d-cc74-4ad0-811a-9a0f414ee2e2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.167563 Sep 08 01:16:59.178096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 295/586] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:16:59 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:16:59.719591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:16:59.720570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:16:59.726243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:59.726727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:59.727162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:59.727857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:16:59.728366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:16:59.728968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:16:59.877513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:16:59.886122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bc95726f-8357-4b63-aefc-0d04f2d08029 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.171094 Sep 08 01:16:59.886745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 292/587] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:16:59 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:00.006889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:00.007673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:00.014801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.015296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.015741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:00.016488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.016944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.017373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:00.174825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:00.186052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5f09330a-3442-4a76-b602-2d502c7282f1 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.182797 Sep 08 01:17:00.200726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 296/588] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:00 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:00.207495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:00.208370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:00.216665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.217372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.217950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:00.218896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.219775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.220541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:00.379651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:00.389810 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:00.391269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:00.392549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7730453d-d173-4c1d-901d-b50f1d75c41c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.189930 Sep 08 01:17:00.393113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 293/589] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:17:00 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:17:00.909147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:00.910149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:00.917461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.918584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.919129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:00.920043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:00.920631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:00.921091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:01.069697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:01.078297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b435d32e-61fd-4e68-b85b-b90deabd02ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.173178 Sep 08 01:17:01.090277 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 297/590] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:00 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:01.211068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:01.211706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:01.219101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:01.219576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:01.220006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:01.220774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:01.221222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:01.221602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:01.390274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:01.398731 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-00558fd2-30cc-414b-a91a-08f63acf3705 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.191577 Sep 08 01:17:01.399391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 294/591] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:01 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:01.419579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:01.420484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:01.426604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:01.427098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:01.427529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:01.428283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:01.428745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:01.429173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:01.577032 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:01.587841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:01.591308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:01.593224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-528cb517-25ea-4faa-a979-4ac60b3b14e1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.178150 Sep 08 01:17:01.603987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 298/592] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:17:01 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:17:02.103563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:02.104491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:02.112206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.112710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.113147 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.113896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.114476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.114894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.273688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:02.282491 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1214e9ab-5335-43d8-80c6-a7d1aae7de97 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.183432 Sep 08 01:17:02.283072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 295/593] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:02 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:02.422567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:02.423102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:02.429631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.430110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.430543 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.431241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.431696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.432123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.447384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:02.604595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:02.614291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1b501893-c48f-4169-a92d-8007eaaf4546 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.195691 Sep 08 01:17:02.615484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 299/594] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:02 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:02.618713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:02.619333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:02.626794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.627279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.627890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.629837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:02.630939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:02.631538 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:02.791145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:02.800289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:02.801785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:02.802957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5cd65b76-5d22-47cd-a9e2-7210571a5009 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.188373 Sep 08 01:17:02.803530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 296/595] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:17:02 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:17:03.306233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:03.306965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:03.314209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.314800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.315240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.315939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.316422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.316852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.485909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:03.495090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6158950c-b8c6-483c-925a-35851f5507ef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.192515 Sep 08 01:17:03.509089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 300/596] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:03 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:03.645529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:03.646219 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:03.657624 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.658649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.659714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.660862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.661326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.661864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.829706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:03.830289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:03.838094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.838778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.839385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.841058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:03.842172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:03.842835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:03.861903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:03.876889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8e97186a-09eb-47e3-b073-a4f8cf8b75c6 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.236513 Sep 08 01:17:03.877788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 297/597] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:03 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:04.022392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:04.033289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:04.035054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:04.036604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fcdac208-d9fc-46f2-8092-54c9249e0354 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1807 microversion: 2.20 time: 0.211713 Sep 08 01:17:04.054825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 301/598] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:17:03 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:17:04.521008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:04.522312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:04.529553 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:04.530033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:04.530465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:04.531154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:04.531606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:04.532057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:04.678948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:04.686576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b6f6a833-da72-4c97-b98d-6ac6f27daea9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.169677 Sep 08 01:17:04.687132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 298/599] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:04 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:04.908645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:04.911660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:04.927241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:04.928038 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:04.930062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:04.931557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:04.932946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:04.934331 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:05.062961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:05.063615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:05.069561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:05.070042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:05.070480 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:05.071173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:05.071630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:05.072061 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:05.077881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:05.104763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:05.117575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-792f7fe4-f344-428c-bfee-628346a38807 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.217574 Sep 08 01:17:05.119248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 302/600] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:04 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:05.236899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:05.245394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:05.247001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:05.248209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-519ffddc-8ef6-4ecf-883b-437280f27093 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1794 microversion: 2.20 time: 0.190035 Sep 08 01:17:05.248772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 299/601] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:17:05 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1794 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:17:05.712345 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:05.713998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:05.724195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:05.724908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:05.725533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:05.726403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:05.727017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:05.727594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:05.896733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:05.908278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4c38625b-524a-4ea4-a235-807abfffc9d7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.201788 Sep 08 01:17:05.909448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 303/602] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:05 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:06.150476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:06.151715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:06.163720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:06.165000 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:06.165637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:06.166812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:06.167468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:06.169006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:06.335171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:06.350659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-612d17be-c459-48a7-9470-2cc1462000b4 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.208034 Sep 08 01:17:06.352776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 300/603] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:06 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:06.930915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:06.931548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:06.938337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:06.938810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:06.939240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:06.939921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:06.940390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:06.940809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:07.076721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:07.084271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-39c0e4a1-7695-4cf1-a7c1-2d1de52276ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.157140 Sep 08 01:17:07.084836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 304/604] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:06 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:07.374796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:07.375412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:07.381587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:07.382055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:07.382490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:07.383176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:07.383625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:07.384346 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:07.529408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:07.537675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b4683c10-621b-4f0b-8844-d188aae0b89f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.166775 Sep 08 01:17:07.538239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 301/605] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:07 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:08.107701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:08.108343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:08.114667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.115144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.115577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:08.116299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.116752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.117173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:08.245547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:08.253985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7b2acb32-a82b-4760-bf3a-5e19fc9461aa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.150198 Sep 08 01:17:08.254577 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 305/606] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:08 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:08.561749 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:08.562362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:08.568761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.569234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.569666 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:08.570348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.570794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.571215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:08.711890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:08.720543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-212dc07d-3ee8-4ea8-9a1e-09ab96662582 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.163315 Sep 08 01:17:08.721102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 302/607] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:08 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:08.975719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:08.978191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:08.984347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.984836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.985270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:08.985957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:08.986411 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:08.986835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:09.282202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:09.286265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:09.303608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:09.304505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:09.305316 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:09.306470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:09.307245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:09.307914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:09.330251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0d012769-7918-400b-9aaa-e2535a245326 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358130 Sep 08 01:17:09.338462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 306/608] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:17:08 2022] POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:09.510725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:09.520665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a0200730-5175-40a2-be07-24f5d3375f13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.245514 Sep 08 01:17:09.521242 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 303/609] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:09 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:09.747121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:09.748651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:09.754875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:09.755409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:09.755788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:09.756499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:09.756945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:09.757391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:09.909545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:09.918738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-392ed38a-746e-4d56-9171-3f363575c09d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.176639 Sep 08 01:17:09.919689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 307/610] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:09 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:10.134847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f1bb575-eef3-44d3-bf63-ab6811596a26", "device": "/dev/sdb"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:10.137986 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:10.144893 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.145374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.145859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:10.146562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.147072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.147555 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:10.519934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-286a7d4d-42d3-458c-a432-53cb54940b9f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "POST /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389220 Sep 08 01:17:10.526095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 304/611] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:17:10 2022] POST /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:10.544517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:10.545001 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:10.552545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.553137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.553746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:10.554597 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.555204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.555628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:10.705867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:10.714137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c036a954-fc29-4ca9-ab7f-ec52a21bbf17 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.175000 Sep 08 01:17:10.715076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 308/612] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:10 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:10.943099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:10.943811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:10.950431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.950913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.951354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:10.952048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:10.952536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:10.952965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:11.117184 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:11.125866 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6eb66ae5-d211-4cd8-9de9-b4b3e12f3768 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.186937 Sep 08 01:17:11.126432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 305/613] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:10 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:11.398808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707afd55-651c-49f6-9e30-7121f95a33dd", "name": "network-vif-plugged", "status": "completed", "tag": "34fff18a-0060-4b00-9710-133c7f049719"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:11.408945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:11.409415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:11.409831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:11.421023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] Creating event network-vif-plugged:34fff18a-0060-4b00-9710-133c7f049719 for instance 707afd55-651c-49f6-9e30-7121f95a33dd on hv-cinder-84773 Sep 08 01:17:11.425863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-ca2d1ccc-3d6b-4cd8-8f09-09aa12e3b929 req-73871373-17ae-4864-ba13-3f2f0b2b777c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030694 Sep 08 01:17:11.426677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 309/614] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:17:11.737378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:11.738003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:11.744447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:11.744925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:11.745360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:11.746549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:11.746994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:11.747420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:11.878580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:11.886967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d7da644f-0e17-4aa4-88da-5ea96bb58037 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.152860 Sep 08 01:17:11.887640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 306/615] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:11 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:12.150351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:12.150960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:12.157546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:12.158014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:12.158445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:12.159118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:12.159562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:12.159979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:12.311424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:12.319680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c5040eea-999d-4922-ad23-b59fb48ad529 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.173909 Sep 08 01:17:12.320242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 310/616] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:12 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:12.909288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:12.909899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:12.916273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:12.916804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:12.917188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:12.917970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:12.918333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:12.918758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:13.047187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:13.054698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-755bfb2f-88a4-49d5-a225-2b6e8c53c305 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.149296 Sep 08 01:17:13.055258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 307/617] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:12 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:13.343444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:13.344048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:13.350969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:13.351442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:13.351871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:13.352592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:13.353042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:13.353467 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:13.499596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:13.507753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d64cc88e-a5b3-45c0-8959-e14f18f8d1ff tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.168389 Sep 08 01:17:13.508348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 311/618] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:13 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:14.077616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:14.078221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:14.080659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:14.085800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:14.086272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:14.086703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:14.087382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:14.087825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:14.088269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:14.219182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:14.226781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d09a7169-58f2-4661-97b0-f6dbe3305673 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.153239 Sep 08 01:17:14.227337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 308/619] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:14 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:14.531631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:14.532259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:14.538613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:14.539083 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:14.539510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:14.540201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:14.540644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:14.541059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:14.683689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:14.691806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ddebec35-855a-487f-9cc8-15fdd6771610 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.164668 Sep 08 01:17:14.692409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 312/620] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:14 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:15.250416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:15.251003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:15.257513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:15.257988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:15.258527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:15.259995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:15.260902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:15.261758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:15.393776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:15.401372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-930d9846-9648-4090-912a-6215d1d9efcd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1366 microversion: 2.1 time: 0.154855 Sep 08 01:17:15.402701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 309/621] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:15 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:15.715483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:15.716086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:15.722487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:15.722959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:15.723393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:15.724074 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:15.724547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:15.724970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:15.872536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:15.880578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4e147787-10d7-4a40-8e3e-61c16363e14c tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.169409 Sep 08 01:17:15.881152 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 313/622] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:15 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:16.424609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:16.425216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:16.431570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.432049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.432515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:16.433864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.434445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.434871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:16.565174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:16.572645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7e194eb4-9ca6-48ee-bd41-330f1ca3d133 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1556 microversion: 2.1 time: 0.151902 Sep 08 01:17:16.573208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 310/623] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:16 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:16.595021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:16.595441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:16.597388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=64 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:16.602629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.603105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.603533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:16.604242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.605215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.605646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:16.685706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a367fbed-44bb-44c9-90aa-05da1473ce29 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094571 Sep 08 01:17:16.686300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 314/624] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:17:16 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:16.904237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:16.905232 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:16.911680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.912195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.912634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:16.913640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:16.914195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:16.914704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:17.067008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:17.085435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bce9b0d5-6f1d-4aa9-81d1-6eb537b18098 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.185078 Sep 08 01:17:17.086228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 311/625] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:16 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:17.652805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707afd55-651c-49f6-9e30-7121f95a33dd", "tag": "34fff18a-0060-4b00-9710-133c7f049719"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:17.663975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:17.664616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:17.665141 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:17.680233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] Creating event network-changed:34fff18a-0060-4b00-9710-133c7f049719 for instance 707afd55-651c-49f6-9e30-7121f95a33dd on hv-cinder-84773 Sep 08 01:17:17.687160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-6981023e-fd31-4c38-b0e3-3ff821c2e858 req-209dc942-2163-4b04-98af-5216fdf87fb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039118 Sep 08 01:17:17.687848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 315/626] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:18.110858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:18.111545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:18.118040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:18.118591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:18.119095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:18.119852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:18.121013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:18.121652 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:18.264793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:18.273045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1bd9503f-62f7-4512-b065-c5f0384ddcf9 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.166196 Sep 08 01:17:18.273620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 312/627] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:18 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:18.556732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:18.557549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:18.564447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:18.565079 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:18.565771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:18.566618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:18.567330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:18.567863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:18.643924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:18.729343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lazy-loading 'services' on Instance uuid 57bfe335-f009-4567-b8b1-b1f1fb648d59 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:18.851449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-40902d6c-395b-4252-b64e-b776a6a2c923 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments/5deda23a-8007-42b0-b76a-0d7354127038" status: 202 len: 0 microversion: 2.1 time: 0.298975 Sep 08 01:17:18.852039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 316/628] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:17:18 2022] DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments/5deda23a-8007-42b0-b76a-0d7354127038 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:17:19.049125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:19.051534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:19.057620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.058250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.058711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.059393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.059837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.060292 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.083763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'flavor' on Instance uuid 3e6b6b63-526f-482b-90ec-27c0b4d858a7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:19.194366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:19.244562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-335003f0-9eab-4c62-a7b5-e54038b91a62 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/action" status: 200 len: 32 microversion: 2.1 time: 0.199384 Sep 08 01:17:19.245752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 313/629] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:17:19 2022] POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:17:19.256209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:19.256921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:19.265220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.265986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.266425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.267136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.267586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.268382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.297795 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:19.298914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:19.305482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.306051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.306608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.307351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:19.308707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:19.309145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:19.451366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:19.461802 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-74b56250-e8e9-4308-bbc3-d1e6c69267e6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.209608 Sep 08 01:17:19.462631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 317/630] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:19 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:19.559881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:19.568541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-43b9a7c0-507b-4997-ac22-dc814510716f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.275015 Sep 08 01:17:19.569114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 314/631] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:19 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:20.486205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:20.486818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:20.493274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:20.493763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:20.494196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:20.495202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:20.496422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:20.496850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:20.592841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:20.593445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:20.600405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:20.600886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:20.601575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:20.602275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:20.602721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:20.603465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:20.641050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:20.649373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bd4abde2-33a6-4f50-96bc-4d63ad77f30c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.166973 Sep 08 01:17:20.650161 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 318/632] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:20 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:20.830558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:20.838710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a2a3b55e-ca96-4a37-a1d7-ab4b9a24e50f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1756 microversion: 2.1 time: 0.250543 Sep 08 01:17:20.840021 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 315/633] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:20 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:21.674084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:21.675239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:21.682276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:21.684076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:21.684803 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:21.685745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:21.686205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:21.686635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:21.863658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:21.864313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:21.872062 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:21.872595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:21.873268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:21.873972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:21.875084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:21.875669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:21.927224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:21.936563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f26e130b-e7a0-4b3b-8d4c-28e483082dcf tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.266194 Sep 08 01:17:21.957876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 319/634] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:21 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:22.061847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:22.070644 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9c204937-c494-4463-a173-e9af705757d5 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1759 microversion: 2.1 time: 0.211495 Sep 08 01:17:22.071922 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 316/635] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:21 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1759 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:22.965759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:22.966326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:22.973157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:22.974288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:22.974735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:22.975440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:22.976078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:22.976536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:23.192026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:23.204951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb1b0ca1-5b7a-4172-bcca-01f713c2f13e tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.243913 Sep 08 01:17:23.205723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 320/636] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:22 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:24.230115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:24.231752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:24.242149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:24.242831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:24.243643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:24.244675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:24.246784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:24.247542 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:24.443751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:24.458826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a71fc2fa-2dcd-437b-b6e9-e2c1d6ac45e9 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.234207 Sep 08 01:17:24.474200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 317/637] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:24 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:25.484499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:25.485935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:25.509635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:25.510128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:25.516121 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:25.516963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:25.517447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:25.517887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:25.789014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:25.799653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-af4f4322-189b-4e2d-8bb4-bc3c4d92ad28 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.319211 Sep 08 01:17:25.804024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 321/638] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:25 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:26.831993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:26.836021 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:26.846466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:26.847420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:26.849522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:26.850992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:26.851808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:26.852500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:27.177001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:27.187992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8016624f-1a9c-4a98-8e43-721582508c72 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.361085 Sep 08 01:17:27.203840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 318/639] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:26 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:27.551097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:27.560319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:27.560916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:27.561366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:27.585739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Going to try to stop instance {{(pid=120715) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 01:17:27.642184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dca3ac96-3d95-46e7-af9b-46eb07918693 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action" status: 202 len: 0 microversion: 2.1 time: 0.095500 Sep 08 01:17:27.642932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 322/640] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:17:27 2022] POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:17:27.652256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:27.653311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:27.661709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:27.662393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:27.663004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:27.663938 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:27.664595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:27.665477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:27.904258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:27.914480 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-92bad5ba-311a-4c25-94dc-e5d850f7c8a1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.266674 Sep 08 01:17:27.931520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 319/641] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:27 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:28.216618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:28.217982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:28.226051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:28.226941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:28.227614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:28.228706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:28.229478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:28.230298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:28.513553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:28.530451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-01b6c1f2-0fa0-447b-a71c-fd3dfc1968c5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.320932 Sep 08 01:17:28.531113 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 323/642] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:28 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:28.939476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:28.940855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:28.947560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:28.948410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:28.949107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:28.950052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:28.950617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:28.951109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:29.241327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:29.253360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-46b6d45e-e025-448c-8264-a46ae3a233be tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.317630 Sep 08 01:17:29.255266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 320/643] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:28 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:29.559416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:29.560066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:29.570036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:29.570526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:29.571188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:29.571902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:29.572579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:29.573864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:29.785934 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:29.796693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ffc2d6e0-2599-4399-8ef4-bc80903fe317 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.240948 Sep 08 01:17:29.797692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 324/644] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:29 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:30.281073 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:30.282620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:30.296441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:30.301328 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:30.301777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:30.303769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:30.304271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:30.304846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:30.555501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:30.566256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-44707da1-6009-42e1-9ff8-702fccac96e6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.291229 Sep 08 01:17:30.567806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 321/645] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:30 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:30.822427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:30.823080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:30.834398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:30.835785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:30.835785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:30.836098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:30.836608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:30.837034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:30.853012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-33f929e0-ccc3-469a-9042-a26b90ca54ee tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Action: 'create', calling method: .version_select at 0x7fe9c9b4db80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-979447183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY+HgD9DkLMF+2DFNd6nkAvRAANVhK5j9tjYCAdS6r98HPwJEEW8ddl6nbwffEhQyWUejUge+sh0+dPXAEJ4BVvRO/ylx58ia0lRSMohwFRuM6IFE/ITHOgLstGQOw53Q=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:30.876102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-33f929e0-ccc3-469a-9042-a26b90ca54ee tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for project 4221b10efb3d4bb799d820e985a48651. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:17:30.880841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-33f929e0-ccc3-469a-9042-a26b90ca54ee tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for user 744fe07ea5644157bdbf11d81adbab89 and project 4221b10efb3d4bb799d820e985a48651. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:17:30.913093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-33f929e0-ccc3-469a-9042-a26b90ca54ee tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.297919 Sep 08 01:17:30.920734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 325/646] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:17:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:30.995416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:31.005519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e649eb11-dcce-48e6-a8c2-65792dd6c53d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.186969 Sep 08 01:17:31.006101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 322/647] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:30 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:31.592045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:31.592736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:31.599939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:31.600451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:31.600893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:31.601588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:31.602034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:31.602472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:31.851136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:31.862462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a04933b-e2af-4baa-be77-27236eaae3a0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.275390 Sep 08 01:17:31.868070 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 326/648] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:31 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:32.032243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:32.033707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:32.040464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:32.041184 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:32.041423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:32.042825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:32.043462 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:32.043897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:32.198718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:32.207229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a3d8a2b3-00ed-4562-89c2-0cdfd1ffeacd tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.179133 Sep 08 01:17:32.208110 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 323/649] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:32 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:32.892488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:32.893709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:32.900595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:32.901283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:32.901822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:32.902432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:32.902922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:32.903356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:33.050550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:33.062301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5c123b7e-4cf9-4811-903e-0b06d4d74786 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.173728 Sep 08 01:17:33.062883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 327/650] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:32 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:33.236620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:33.237446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:33.243879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:33.244752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:33.245502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:33.246412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:33.246779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:33.247196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:33.410820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:33.430022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-76bcb5c1-a3a3-4483-881d-78edae14b71d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.197878 Sep 08 01:17:33.440158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 324/651] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:33 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:34.086235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:34.086844 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:34.093833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:34.094318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:34.094760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:34.095453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:34.095893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:34.096348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:34.252895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:34.261634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e700280c-59df-4819-8c1f-64f2b29e812f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.178398 Sep 08 01:17:34.262503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 328/652] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:34 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:34.457389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:34.459585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:34.468490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:34.469009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:34.469449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:34.470144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:34.470593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:34.471217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:34.695147 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:34.708291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e38c3289-6734-435b-a2c9-606564fc6ce1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.256237 Sep 08 01:17:34.710030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 325/653] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:34 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:35.286306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:35.286905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:35.293947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:35.294428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:35.294860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:35.295552 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:35.295997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:35.296447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:35.429401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:35.437257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8da53612-1fa4-4af1-be11-73b69cf81136 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.155790 Sep 08 01:17:35.437818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 329/654] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:35 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:35.735412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:35.736020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:35.742813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:35.743294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:35.745403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:35.745403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:35.745621 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:35.746268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:35.886500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:35.894783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-468fc70f-5b5c-4440-8e5f-5427e87c7543 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.163192 Sep 08 01:17:35.895341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:35 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:36.460616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:36.461234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:36.468656 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:36.469234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:36.469567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:36.470262 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:36.470725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:36.471153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:36.608624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:36.616267 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d55b2ca1-e8b2-4d95-b378-4c13776d1fe1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.159442 Sep 08 01:17:36.617113 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 330/656] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:36 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:36.917698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:36.918232 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:36.924793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:36.925278 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:36.925715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:36.926406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:36.926863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:36.927293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:37.062982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:37.071104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7c0f6233-f98d-4636-9db5-b0fe571863ab tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.157673 Sep 08 01:17:37.071662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 327/657] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:36 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:37.639562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:37.640192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:37.646588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:37.647061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:37.647492 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:37.648191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:37.648640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:37.649066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:37.777573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:37.785167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb4c5c8e-4e41-4ad1-8339-c478f0780886 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.149910 Sep 08 01:17:37.785725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 331/658] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:37 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:38.095493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:38.096106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:38.102528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:38.103016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:38.103455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:38.104220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:38.104636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:38.105112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:38.238412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:38.247919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f8bad604-402b-4597-a9ef-a95f0bc29d0f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.156188 Sep 08 01:17:38.248502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 328/659] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:38 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:38.809764 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:38.810382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:38.818441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:38.818935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:38.819369 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:38.820385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:38.820846 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:38.821276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:38.836815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:38.953984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:38.961614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0067ed0a-e13e-4a99-b20d-7df196acba26 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.155773 Sep 08 01:17:38.962182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 332/660] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:38 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:39.272421 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:39.273031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:39.280115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:39.280628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:39.281069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:39.281761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:39.282274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:39.282710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:39.286794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:39.415391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:39.424022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-306696fc-f0ee-45bd-97e5-679f93507672 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.155570 Sep 08 01:17:39.424612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 329/661] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:39 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:39.986084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:39.986694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:39.993094 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:39.993567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:39.994002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:39.995326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:39.995785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:39.996249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:40.136144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:40.143810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-462bc534-b016-4894-9038-5325b9ea41bb tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.161608 Sep 08 01:17:40.144421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 333/662] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:39 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:40.448546 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:40.449160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:40.455615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:40.456098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:40.456574 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:40.457267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:40.457725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:40.458161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:40.603051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:40.611574 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9d84f96e-bc45-4a23-8e68-6e6b6a81daf2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.167539 Sep 08 01:17:40.612146 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 330/663] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:40 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:41.167300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:41.167821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:41.169747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:41.175771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:41.176388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:41.176895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:41.177700 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:41.178241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:41.178671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:41.321337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:41.329268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-72525b09-a083-4c29-a055-cfc16227e0bf tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.165982 Sep 08 01:17:41.329847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 334/664] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:41 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:41.634879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:41.635446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:41.641874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:41.642356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:41.642794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:41.643488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:41.643942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:41.644404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:41.775468 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:41.785076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b66024ba-e4fd-4c28-be63-9072d4e88060 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.154454 Sep 08 01:17:41.785854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 331/665] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:41 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:42.352195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:42.352838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:42.359406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:42.359885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:42.360363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:42.361059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:42.361531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:42.361954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:42.497016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:42.504598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-82be0f1d-373d-474e-a464-6785edcf12d0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.156357 Sep 08 01:17:42.505160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 335/666] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:42 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:42.809793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:42.810388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:42.816818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:42.817294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:42.817734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:42.818413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:42.818863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:42.819282 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:42.947935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:42.956162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7b19e871-493b-4c44-8cfe-03628d14b63b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.150934 Sep 08 01:17:42.956852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 332/667] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:42 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:43.529105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:43.529694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:43.536004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:43.536511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:43.536949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:43.537634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:43.538088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:43.538513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:43.669144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:43.676796 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a14d1a4-fd86-4027-b4ea-4bf730e656de tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.151597 Sep 08 01:17:43.677285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 336/668] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:43 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:43.981332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:43.981867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:43.988182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:43.988662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:43.989094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:43.989778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:43.990227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:43.990651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:44.204040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:44.204558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:44.210922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:44.211583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:44.212508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:44.212824 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:44.213457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:44.214138 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:44.311192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lazy-loading 'services' on Instance uuid 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:44.391621 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:44.392823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2cab95fe-3f7e-4270-8049-9fff39c0651d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2/os-volume_attachments/1f1bb575-eef3-44d3-bf63-ab6811596a26" status: 202 len: 0 microversion: 2.1 time: 0.192522 Sep 08 01:17:44.393417 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 337/669] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:17:44 2022] DELETE /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2/os-volume_attachments/1f1bb575-eef3-44d3-bf63-ab6811596a26 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:17:44.400525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-312d476c-9094-49f2-81fa-6e6622dfdfc2 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1731 microversion: 2.1 time: 0.423449 Sep 08 01:17:44.401091 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 333/670] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:43 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1731 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:44.701357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:44.702060 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:44.708162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:44.708652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:44.709087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:44.709769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:44.710217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:44.710639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:44.844698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:44.852378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-24b08730-cef4-4828-855f-45a1078873df tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.155644 Sep 08 01:17:44.852948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 338/671] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:44 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:45.426181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:45.427649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:45.431711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=52 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:45.436854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.437353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.437794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.438507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.438965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.439395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.584448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:45.593485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b739214e-88b3-4e84-9701-0656889f36e8 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1711 microversion: 2.1 time: 0.172071 Sep 08 01:17:45.594040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 334/672] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:45 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1711 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:45.710635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:45.711120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:45.718067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.718541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.718972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.719645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.720090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.720531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.798194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] HTTP exception thrown: Cannot 'detach_volume' instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 while it is in vm_state rescued Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Request method failure captured: Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments/f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605 HTTP/1.1 Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG__Wf4mSFJF-q4KkfIdpEprqCkTrzo5YXOLw946PqSzz9gHlrtgc3sV9ROQvEfB4vnWlCUbaAgcgvYaYubxac0jZibBE-19dVA3xbcGAP4PYPktKnAcvi1061czlEWieZwaM-YisPxSPZVr9nz5CMMu5If6EToYYRq2o3nQ-USdIo Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:17:45.799790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f520f61ec5304a72ac707318d3a73b4f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f520f61ec5304a72ac707318d3a73b4f"}]}] Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 20af4425b7434d2dab7baeacbb845387 Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:17:45.801425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Cannot 'detach_volume' instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 while it is in vm_state rescued Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'server_id': '3e6b6b63-526f-482b-90ec-27c0b4d858a7', 'id': 'f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605'} Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:17:45.802224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 while it is in vm_state rescued Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 while it is in vm_state rescued Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:45.803838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Returning 409 to user: Cannot 'detach_volume' instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 while it is in vm_state rescued {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:17:45.805046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c8df7523-f408-4ebf-b02c-3866270ab000 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments/f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605" status: 409 len: 152 microversion: 2.1 time: 0.094598 Sep 08 01:17:45.805046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 339/673] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:17:45 2022] DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments/f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605 => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 01:17:45.810372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:45.810913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:45.816910 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.817519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.817965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.818768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.819225 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.819644 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.876031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:45.876784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:45.885477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6e29a0bc-c961-43e3-aff0-4c9ee1198cc5 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/action" status: 202 len: 0 microversion: 2.1 time: 0.079020 Sep 08 01:17:45.885652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.885962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.886107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 335/674] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:17:45 2022] POST /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:17:45.886399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.887699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.888170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.888790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.895006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:45.895702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:45.901830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.902308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.903371 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:45.904164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:45.904634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:45.905049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:46.032649 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:46.040493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7d200d2e-118e-48c5-987a-f12317b5b92e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1679 microversion: 2.1 time: 0.168625 Sep 08 01:17:46.041060 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 340/675] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:45 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:46.045907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:46.054230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ca915c90-3c3b-42a0-9eb3-9b36bbd2c50f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1719 microversion: 2.1 time: 0.163209 Sep 08 01:17:46.054789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 336/676] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:45 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:47.064738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:47.065940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:47.068955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:47.077812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:47.078427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:47.079092 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.079585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.080024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.080750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.081204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.081631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.084945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.085429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.085868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.086600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.087058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.087485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.221845 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:47.223492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:47.229902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2a95ac6b-9ee2-45dd-8ab0-c3317bdd975e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1656 microversion: 2.1 time: 0.168998 Sep 08 01:17:47.230854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 341/677] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:47 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1656 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:47.232406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-449be32e-b341-4062-a4f3-739a776f2c59 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1719 microversion: 2.1 time: 0.159043 Sep 08 01:17:47.232992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 337/678] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:47 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:47.255128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:47.261566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.262140 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.262746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.285453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Going to try to start instance {{(pid=120715) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 01:17:47.326420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5614a8b1-031b-45f3-81bd-619450447b8a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action" status: 202 len: 0 microversion: 2.1 time: 0.075826 Sep 08 01:17:47.326996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 342/679] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:17:47 2022] POST /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:17:47.335107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:47.335712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:47.341832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.342312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.342747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.343431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.343880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.344339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.475148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:47.483325 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1f3f4025-1ec1-4676-97e8-79d21438e652 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.152109 Sep 08 01:17:47.483888 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 338/680] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:47 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:47.645490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:47.646076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:47.652103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.653196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.653739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.654434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.654887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.655311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.680701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:17:47.760594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0feff3a5-f56f-47d0-9088-e6e17cc74ba1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 204 len: 0 microversion: 2.1 time: 0.118886 Sep 08 01:17:47.761185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 343/681] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:17:47 2022] DELETE /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:17:47.769529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:47.770127 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:47.776057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.776569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.777000 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.778307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:47.778795 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:47.779212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:47.914543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:47.926279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4bf03e03-e92d-40d9-bc67-b2abcb0b4b70 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1513 microversion: 2.1 time: 0.160465 Sep 08 01:17:47.926852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 339/682] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:47 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:48.260946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:48.261666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:48.269400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.269874 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.270303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:48.270984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.271429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.271847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:48.411073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:48.419569 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68f9a62b-71de-4fd0-9189-946bb0fad951 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1719 microversion: 2.1 time: 0.163478 Sep 08 01:17:48.420123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 344/683] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:48 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:48.506611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:48.507236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:48.514561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.514973 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.515401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:48.516077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.516548 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.516964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:48.650174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:48.658545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f3838e16-cf4d-4d4b-a7cd-de395f88e9b1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.155710 Sep 08 01:17:48.659102 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 340/684] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:48 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:48.950998 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:48.951526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:48.957497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.957971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.958402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:48.959084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:48.959534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:48.959958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:49.089764 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:49.093040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:49.100544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-47ab4914-3d98-4d29-854d-bb9952be9d6c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1513 microversion: 2.1 time: 0.153589 Sep 08 01:17:49.101107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 345/685] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:48 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:49.443003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:49.443612 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:49.450847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:49.451326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:49.451759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:49.452478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:49.452931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:49.453352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:49.582676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:49.590747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a20b89a-d5f7-4dc5-bd36-7947d4179ab0 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1719 microversion: 2.1 time: 0.151587 Sep 08 01:17:49.591302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 341/686] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:49 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:49.682580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:49.683188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:49.690730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:49.691213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:49.691651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:49.692396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:49.692853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:49.693276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:49.830752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:49.838420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07654fde-030e-4252-9f13-f369ac8d02d2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.159722 Sep 08 01:17:49.838996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 346/687] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:49 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:50.124855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:50.125392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:50.131373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.131882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.132342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:50.133052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.133518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.134199 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:50.262785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:50.271247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b3628255-d6ef-4cff-beb2-26eaa2bcc131 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1513 microversion: 2.1 time: 0.150855 Sep 08 01:17:50.271811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 342/688] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:50 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:50.614558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:50.615170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:50.621746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.622226 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.622669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:50.623364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.623842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.624300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:50.752306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:50.760659 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b03c3db1-942a-4c18-859c-3300287c5297 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1719 microversion: 2.1 time: 0.149959 Sep 08 01:17:50.761236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 347/689] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:50 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:50.861511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:50.862114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:50.868490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.868909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.869336 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:50.870011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:50.870455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:50.870871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.002390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:51.010194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d1fe9689-cb75-4993-9ada-3e751da003d5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.152462 Sep 08 01:17:51.010757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 343/690] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:50 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:51.294962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:51.296013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:51.302573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.303072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.303512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.304252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.304709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.305134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.436852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:51.444617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d341e4e-d615-4d70-a01c-dc15d5800f6b tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1513 microversion: 2.1 time: 0.153763 Sep 08 01:17:51.445188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 348/691] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:51 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:51.785054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:51.785650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:51.791725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.792281 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.792716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.793440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.794030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.794442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.925724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:51.929205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:17:51.935279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-290be399-5e45-44dd-ac72-e28834297f65 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1725 microversion: 2.1 time: 0.154072 Sep 08 01:17:51.935848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 344/692] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:51 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:51.958650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:51.959145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:51.966138 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.966643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.967074 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:51.967753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:51.968222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:51.968643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.034378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:52.035017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:52.043048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:52.043578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:52.044002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.044722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:52.045168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:52.045603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.051991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dc7577e4-9d2f-43a2-8ad7-442eb88dcce3 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097117 Sep 08 01:17:52.052631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 349/693] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:17:51 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:52.330256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:52.338067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ae1076bd-e1a8-414d-9be0-aea9e8b59fc3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.307460 Sep 08 01:17:52.339007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 345/694] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:52 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:17:52.467634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:52.468599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:52.474390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:52.474898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:52.475336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.476028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:52.476503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:52.477144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.716444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:52.725553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3c44ce18-a2f7-486e-993d-cac5136cf1ba tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1513 microversion: 2.1 time: 0.262325 Sep 08 01:17:52.726448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 350/695] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:52 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:52.965139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd1f622-0e3c-40ee-a8d1-4768c456e8f2", "name": "network-vif-deleted", "tag": "615bdb45-f330-4435-9115-4359c278c980"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:52.975978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:52.976527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:52.976966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:52.988837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] Creating event network-vif-deleted:615bdb45-f330-4435-9115-4359c278c980 for instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 on hv-cinder-84773 Sep 08 01:17:52.995075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-60360e39-47fa-4085-8552-170ff6073454 req-a01d4b44-3041-450d-8af9-4fd931aa0094 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Sep 08 01:17:52.996048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 346/696] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:17:53.063854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:53.073789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.074274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.075481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.088641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] Creating event network-changed:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:17:53.095095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-21038eab-04a8-4e20-8c4b-0978af5ec67f req-5df1bc43-0ef4-4d96-9f52-e12439c1df17 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035810 Sep 08 01:17:53.095711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 351/697] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:17:53.363712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:53.364439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:53.377494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.378240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.378840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.379700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.380513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.381187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.602723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:53.611120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b0cb1607-a639-4af0-851f-c215eb4ca196 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1665 microversion: 2.1 time: 0.252405 Sep 08 01:17:53.621200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 347/698] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:53 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1665 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:53.750446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:53.751946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:53.758399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.759159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.759592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.760340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.760792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.761571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.804557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:53.805179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:53.805623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:53.806069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lazy-loading 'fault' on Instance uuid 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:53.851346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:53.859993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-60320f6c-cbc8-4a66-8f2b-29156b7af28d tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1308 microversion: 2.1 time: 0.114460 Sep 08 01:17:53.860643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 352/699] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:53 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1308 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:54.635571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:54.636193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:54.643156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:54.643628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:54.644057 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:54.644766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:54.645214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:54.645626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:54.774237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:54.782243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4553a6b7-0aba-4596-a73f-361a5d9880e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1669 microversion: 2.1 time: 0.150826 Sep 08 01:17:54.782831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 348/700] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:54 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:54.882682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:54.884165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:54.891563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:54.892357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:54.892954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:54.893976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:54.894632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:54.895379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:54.929265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:54.929745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:54.930184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:54.930624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lazy-loading 'fault' on Instance uuid 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:54.975989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:54.986739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6386e632-d883-4006-8b51-d4564d224521 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 200 len: 1308 microversion: 2.1 time: 0.107708 Sep 08 01:17:54.987252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 353/701] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:54 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:55.110392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:55.119797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:55.120313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:55.120751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:55.131545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] Creating event network-changed:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:17:55.136865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-44e370ad-1e07-46c3-8475-a5a780e23447 req-dfbbe7f9-b744-44dd-a81c-b3938ec9c6d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030717 Sep 08 01:17:55.137665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 349/702] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:17:55.175285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1846533197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979447183", "security_groups": [{"name": "tempest-secgroup-smoke-18365749"}], "block_device_mapping_v2": [{"uuid": "0a38f1a5-3ccc-4dc2-98af-58f6bca09b35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:17:55.291566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] validate_networks() for [('57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:17:55.663744 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:17:55.664199 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:17:55.664680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:17:55.665126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:17:55.665545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:17:55.674532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:55.675019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:55.675456 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:55.676215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:55.676675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:55.677104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:55.694492 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:17:55.698377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for user 744fe07ea5644157bdbf11d81adbab89 and project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:17:55.756482 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:17:55.758561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a38f1a5-3ccc-4dc2-98af-58f6bca09b35',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:17:55.887234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15fdcdec-b6cd-4eef-9c8d-152408d08b53 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.715706 Sep 08 01:17:55.887948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 354/703] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:17:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:17:55.900064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b0b435bb-8024-467a-946c-08f679c29e67 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:55.900806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b0b435bb-8024-467a-946c-08f679c29e67 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:55.957233 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b0b435bb-8024-467a-946c-08f679c29e67 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:55.964206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b0b435bb-8024-467a-946c-08f679c29e67 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1094 microversion: 2.1 time: 0.068186 Sep 08 01:17:55.964780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 350/704] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:55 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:56.009950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:56.010578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:56.017653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.018132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.018624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.019559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.019793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.020244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.034244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] HTTP exception thrown: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Request method failure captured: Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 HTTP/1.1 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUJZ4l_ACWFf-jc3Yh8NtzNzj3CFFyEXLv6oQ7vKK273tMDKBhYWRxYdFr0aPMD1vh-e2SAeKOs_7GywpgmRrFTHr0ekvJ1bi7bJEEZyrgsEDXJ1OoDYPnlbBcMJ7yrlg3yvJo5yt18Cnj-2zN7ZgTECkuSaf5ezJdGagm7cf1ThapM Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 93477e5edb38498ba32feb52519ba584 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:17:56.035896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93477e5edb38498ba32feb52519ba584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93477e5edb38498ba32feb52519ba584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93477e5edb38498ba32feb52519ba584", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93477e5edb38498ba32feb52519ba584"}]}] Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 93477e5edb38498ba32feb52519ba584 Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesSnapshotTestJSON-1726091172-project Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 336e7f07cd7d461c8257995a772ac1f0 Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesSnapshotTestJSON-1726091172-project Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. Sep 08 01:17:56.037508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '1dd1f622-0e3c-40ee-a8d1-4768c456e8f2'} Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:17:56.038489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. Sep 08 01:17:56.039941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:17:56.041337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Returning 404 to user: Instance 1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:17:56.041337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6a23bd83-943d-427e-8aff-65d8444d7a93 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2" status: 404 len: 111 microversion: 2.1 time: 0.031595 Sep 08 01:17:56.041337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 355/705] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:56 2022] GET /compute/v2.1/servers/1dd1f622-0e3c-40ee-a8d1-4768c456e8f2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:17:56.636631 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:56.637133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:56.643322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.643803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.644347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.645040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.645494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.645921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.677826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3fc1a20b-5e55-472c-a270-774d0be4d451 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments/11bfb25e-edeb-447b-b451-7e6febf161c5" status: 200 len: 194 microversion: 2.20 time: 0.045578 Sep 08 01:17:56.678409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 351/706] 10.222.0.42 () {60 vars in 1454 bytes} [Thu Sep 8 01:17:56 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments/11bfb25e-edeb-447b-b451-7e6febf161c5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:17:56.747680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:56.748240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:56.754748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.755220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.755654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.756376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.756826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.757248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.839939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'services' on Instance uuid e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:17:56.914096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-54f407b6-06b0-4b1d-8e66-26a8f7f53631 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments/11bfb25e-edeb-447b-b451-7e6febf161c5" status: 202 len: 0 microversion: 2.20 time: 0.170320 Sep 08 01:17:56.914683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 356/707] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 8 01:17:56 2022] DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments/11bfb25e-edeb-447b-b451-7e6febf161c5 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:17:56.923331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:56.925510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:56.931820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.932332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.932764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.933439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.933882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.934298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.964325 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e1da8358-c1bc-47e6-8e84-adfaf498bca0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045138 Sep 08 01:17:56.964868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 352/708] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:17:56 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:17:56.987405 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:56.988104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:56.994553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.995034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.995465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:56.996158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:56.996644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:56.997082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:57.058912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:57.066945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8753c158-f220-421a-ba17-61f92da522c5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1192 microversion: 2.1 time: 0.083693 Sep 08 01:17:57.067505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 357/709] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:56 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:57.977959 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:57.980022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:57.987374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:57.987847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:57.988312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:57.988996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:57.989442 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:57.989863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:58.019340 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3e5ff38b-65c4-4768-9f48-d4d963b98d3b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045433 Sep 08 01:17:58.019886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 353/710] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:17:57 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:17:58.090804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:58.091422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:58.098472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:58.098950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:58.099388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:58.100076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:58.100557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:58.100981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:58.164147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:58.172519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8bc42398-86c3-402f-8e8f-89eaaac8d393 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1192 microversion: 2.1 time: 0.085487 Sep 08 01:17:58.173089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 358/711] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:58 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:17:59.031142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:59.033363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:59.039693 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:59.040205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:59.040649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:59.041330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:59.041782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:59.042234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:59.071042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4b3872d1-9543-4cfa-afe8-322a26d2f6fb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044070 Sep 08 01:17:59.071598 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 354/712] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:17:59 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:17:59.196065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:17:59.196720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:17:59.203089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:59.203563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:59.203996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:59.204794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:17:59.205239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:17:59.206188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:17:59.276125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:17:59.283897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-17b33c62-7cca-41e4-b950-d2a7a2c30831 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1192 microversion: 2.1 time: 0.092710 Sep 08 01:17:59.284433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 359/713] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:17:59 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:00.083615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:00.085837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:00.093084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:00.093562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:00.094053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:00.094747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:00.095197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:00.095623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:00.126482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dbe55508-6345-45cf-93cd-02cb3cebbef1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046854 Sep 08 01:18:00.127035 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 355/714] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:18:00 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:18:00.306791 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:00.307527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:00.314912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:00.315434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:00.315959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:00.316917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:00.317371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:00.317920 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:00.393454 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:00.403093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-43917eee-ef5b-4613-9cd7-7d6a0f26fdd5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1200 microversion: 2.1 time: 0.099956 Sep 08 01:18:00.418261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 360/715] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:00 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1200 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:01.140400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:01.142746 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:01.150338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.150838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.151305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.152017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.152504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.152935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.185435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6b9249f6-7426-481e-a75f-cbd512a6fdf8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050009 Sep 08 01:18:01.186153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 356/716] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:18:01 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:01.259701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:01.260231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:01.267084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.268071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.268696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.269520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.269983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.271165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.304699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:01.369684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:01.401645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-add02d37-89a1-400d-b95d-65ce8d8a5da9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 204 len: 0 microversion: 2.20 time: 0.145798 Sep 08 01:18:01.402781 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 361/717] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 8 01:18:01 2022] DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 01:18:01.413108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:01.413883 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:01.422305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.422993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.423579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.424511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.425177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.425688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.431668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:01.431668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:01.443084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.443639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.444107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.444897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.445404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.445840 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.582218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:01.590026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7bfc9f31-6a73-4556-a1f3-cfe3db1133f3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1276 microversion: 2.1 time: 0.166356 Sep 08 01:18:01.590534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 362/718] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:01 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:01.625507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:01.635154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:01.636614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:01.637911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cdebe048-2bcc-4c66-a416-625985a77528 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.230025 Sep 08 01:18:01.638315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 357/719] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:01 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:01.955981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585aa54c-7191-4b3d-bc77-4adf1090b504", "tag": "15a42ea1-d5cf-46a9-9ba0-f0879233878a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:01.965392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:01.965971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:01.966435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:01.979158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] Creating event network-changed:15a42ea1-d5cf-46a9-9ba0-f0879233878a for instance 585aa54c-7191-4b3d-bc77-4adf1090b504 on hv-cinder-84773 Sep 08 01:18:01.984392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-c14157ae-89f5-467a-bec5-27e6e9a56133 req-303ef2ab-3e03-4eca-8133-561d904f14c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032629 Sep 08 01:18:01.985062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 363/720] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:02.613745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:02.614276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:02.620833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:02.621311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:02.621745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:02.622436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:02.622888 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:02.623311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:02.665019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:02.665717 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:02.673232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:02.673711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:02.674148 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:02.674883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:02.675337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:02.675767 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:02.755068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:02.763827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3f012ac2-7520-40f5-9a43-f4efd6bbf057 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1276 microversion: 2.1 time: 0.153651 Sep 08 01:18:02.764536 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:02 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:02.811818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:02.819875 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:02.821347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:02.822523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa397f0c-3423-4d28-a2bc-44362952439f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.161670 Sep 08 01:18:02.823077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 364/722] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:02 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:03.786525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:03.787132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:03.793654 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:03.794128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:03.794552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:03.795745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:03.796204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:03.796622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:03.848368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:03.848969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:03.855373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:03.855847 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:03.856307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:03.856989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:03.857432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:03.858674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:03.933953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:03.942341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c5fe3afa-f420-43b6-a5be-0e37b447d09e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1276 microversion: 2.1 time: 0.159619 Sep 08 01:18:03.942917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 359/723] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:03 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:03.996066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:04.004216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:04.005600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:04.006761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3f4b68f9-ee6a-4961-b255-75936faaae2d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.162283 Sep 08 01:18:04.007359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 365/724] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:03 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:04.964806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:04.966014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:04.973010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:04.973700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:04.974305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:04.975159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:04.975760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:04.976363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:05.027930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-962763072", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "networks": [{"uuid": "7ebb863f-f0f4-4943-8831-11422a5db3a1"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:05.084421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] validate_networks() for [('7ebb863f-f0f4-4943-8831-11422a5db3a1', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:18:05.144985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:05.153142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-15d6f0f0-bc04-4fef-b93c-473811266ea3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.192125 Sep 08 01:18:05.163735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 360/725] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:04 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:05.169364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:05.170518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:05.176833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:05.177315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:05.177750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:05.178438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:05.178916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:05.179401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:05.454354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:18:05.454784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:18:05.455265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:18:05.455681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:18:05.456098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:18:05.465271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:05.465755 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:05.466192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:05.467527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:05.467985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:05.468476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:05.486300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Getting quotas for project 93477e5edb38498ba32feb52519ba584. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:18:05.490349 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Getting quotas for user 336e7f07cd7d461c8257995a772ac1f0 and project 93477e5edb38498ba32feb52519ba584. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:18:05.501904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:18:05.504258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:18:05.554486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7f44676-1c9b-4d22-b053-f864a4b31bdd tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530319 Sep 08 01:18:05.555141 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 366/726] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:18:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 01:18:05.566343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6b9a8657-4c33-42a6-b107-bf33aa12e08a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:05.566963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6b9a8657-4c33-42a6-b107-bf33aa12e08a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:05.580346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:05.657920 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6b9a8657-4c33-42a6-b107-bf33aa12e08a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:05.658137 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:05.666387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6b9a8657-4c33-42a6-b107-bf33aa12e08a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1218 microversion: 2.1 time: 0.103727 Sep 08 01:18:05.667059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:05 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:05.670769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:05.672817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:05.674221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77193edc-1a1d-4a73-8572-b5651b847af0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1722 microversion: 2.20 time: 0.509155 Sep 08 01:18:05.675043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 361/728] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:05 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1722 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:06.178568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:06.179301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:06.192832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.194127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.194762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.195657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.196316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.196921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.362344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:06.380485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a6d7713d-ebe2-4986-a5cb-87874f6877e5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.206859 Sep 08 01:18:06.382259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 368/729] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:06 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:06.689873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:06.690658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:06.693012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:06.699249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.699820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.700061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:06.700422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.701707 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:06.702835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.703303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.703921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.710055 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.710680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.711330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.712049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.713019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.713618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.781967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:06.790294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:06.791712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:06.792897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-77032d43-74b3-43ec-9c64-4b875f76c4b1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1656 microversion: 2.20 time: 0.096736 Sep 08 01:18:06.793453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 369/730] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:06 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1656 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:06.797377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:06.805994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f569bb5d-dc1e-4873-91ae-ea2111b9b804 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1270 microversion: 2.1 time: 0.120200 Sep 08 01:18:06.806761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 362/731] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:06 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1270 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:06.880922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5eca3d5-8f1f-4176-bdbd-fd040a0f1707", "name": "network-vif-deleted", "tag": "d6499fb0-9e6a-4bd4-8670-617b569814a4"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:06.891471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:06.891941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:06.892388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:06.903662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] Creating event network-vif-deleted:d6499fb0-9e6a-4bd4-8670-617b569814a4 for instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 on hv-cinder-84773 Sep 08 01:18:06.909664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-7e20ee08-5786-4d64-87bb-7ce26a312f1e req-e59a37f3-6173-4d0a-ad94-902829381093 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032607 Sep 08 01:18:06.910449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 370/732] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:07.404002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:07.404823 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:07.410895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.411945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.412473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.413193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.413855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.414286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.554660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:07.558249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:07.564521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-51c179fa-653e-4c97-adce-aa8d8c59daa1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.164346 Sep 08 01:18:07.574753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 363/733] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:07 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:07.819306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:07.820255 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:07.827778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.828536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.828957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.829679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.830157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.830582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.831907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:07.832796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:07.841811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.842407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.843237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.844039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.845007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.845007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.869672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:07.870156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:07.870613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:07.871057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'fault' on Instance uuid e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:07.914748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:07.915956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:07.923499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c95214c-011f-4bdb-bfe3-74f1d2f1d805 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1270 microversion: 2.1 time: 0.095895 Sep 08 01:18:07.936248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 364/734] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:07 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:07.936424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:07.936424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:07.936424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1eae3c5-76be-4421-9b96-f967d6feec82 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1370 microversion: 2.20 time: 0.112613 Sep 08 01:18:07.936724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 371/735] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:07 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1370 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:08.588261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:08.597424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:08.611323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.613004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.613628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:08.615983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.617003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.618972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:08.865044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:08.873190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9c44464-ea54-4ceb-a2e2-ef1b85a43763 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.289866 Sep 08 01:18:08.873777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 365/736] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:08 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:08.957005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:08.958755 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:08.959198 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:08.961820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:08.971129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.971613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.972047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:08.975562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.976043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.976849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.977309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.977739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:08.980591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:08.981298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:08.981753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:08.982180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:09.017944 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:09.019303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:09.019906 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:09.020568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'fault' on Instance uuid e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:09.052868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:09.061540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d6928572-ebe3-4e8f-b5d7-84aae2d25013 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1276 microversion: 2.1 time: 0.117042 Sep 08 01:18:09.062558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 372/737] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:08 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:09.077813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:09.091514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:09.094033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:09.095371 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fcc7dbb8-88a8-49ab-ad88-9af341e73b37 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 200 len: 1370 microversion: 2.20 time: 0.146209 Sep 08 01:18:09.096330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 366/738] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:08 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 1370 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:09.898017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:09.898636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:09.904821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:09.905362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:09.905978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:09.906678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:09.907125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:09.907543 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.048770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:10.057412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d273f6d1-b1bd-400b-8859-56d3d904c15b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.163804 Sep 08 01:18:10.057988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 373/739] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:09 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:10.086611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:10.087303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:10.095240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.095722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.096179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.097274 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.097727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.098149 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.103022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd100bc9-2128-4983-aa24-ba2e6c3c7613", "tag": "fc0898bc-c674-41f6-97c5-3e7b9df2ed52"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:10.113995 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.114789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.115536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.128918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] Creating event network-changed:fc0898bc-c674-41f6-97c5-3e7b9df2ed52 for instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 on hv-cinder-84773 Sep 08 01:18:10.134020 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-105f1327-2bf6-47e4-8b44-9da36b832a46 req-632056a1-8569-4e4b-bb0f-be129be87b9a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035962 Sep 08 01:18:10.134809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 374/740] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:10.139731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:10.140396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:10.147531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.148015 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.148483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.149179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.149633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.150056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.165153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 HTTP/1.1 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:18:10.166815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:18:10.168292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'e5eca3d5-8f1f-4176-bdbd-fd040a0f1707'} Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:10.169367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:18:10.171882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:10.173606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:10.173606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d19272a4-abac-4037-8e39-f0b38cb15796 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 404 len: 111 microversion: 2.20 time: 0.032530 Sep 08 01:18:10.173606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 375/741] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:10 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:18:10.177930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b71c371c-ba5f-43fd-b2da-cdcb0f979486 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '.version_select at 0x7fe9c9b4d160>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:10.199475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b71c371c-ba5f-43fd-b2da-cdcb0f979486 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-363302953" status: 204 len: 0 microversion: 2.20 time: 0.025444 Sep 08 01:18:10.200067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 376/742] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Sep 8 01:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-363302953 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 01:18:10.575372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:10.588432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89d8484f-21f8-4267-94db-c3063834bb12 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.505765 Sep 08 01:18:10.589458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 367/743] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:10 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:10.703010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585aa54c-7191-4b3d-bc77-4adf1090b504", "name": "network-vif-plugged", "status": "completed", "tag": "15a42ea1-d5cf-46a9-9ba0-f0879233878a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:10.721994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:10.723315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:10.724279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:10.742628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] Creating event network-vif-plugged:15a42ea1-d5cf-46a9-9ba0-f0879233878a for instance 585aa54c-7191-4b3d-bc77-4adf1090b504 on hv-cinder-84773 Sep 08 01:18:10.749239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a0ab568e-45b7-4602-99f7-9a03af44d500 req-54e602cf-2f0b-4d4e-b96e-e1c2b23c9d96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051780 Sep 08 01:18:10.750493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 377/744] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:10.927058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c1a1c60a-f013-4452-9d59-414245352198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: .version_select at 0x7fe9c9a4bb80>, body: {"keypair": {"name": "tempest-keypair-522112454", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsXYM+Uruv4cX46WbJko9hTMgAcPQHAiC5uTKW3hWcJxEawipTqiVebhmnyhJbiu/D7eRfTLsv8CWoic7tsCiW0BU9VvLyyYwM2y3n6exvzHrzOPfbQSZXoOzmPfGyOww=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:10.942273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-c1a1c60a-f013-4452-9d59-414245352198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:18:10.946854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-c1a1c60a-f013-4452-9d59-414245352198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for user 9f2e208a67d4443eb00c75c60c54173f and project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:18:10.972543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c1a1c60a-f013-4452-9d59-414245352198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049310 Sep 08 01:18:10.973684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 368/745] 10.222.0.42 () {62 vars in 1200 bytes} [Thu Sep 8 01:18:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 01:18:11.081873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:11.082596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:11.089919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:11.090664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:11.091364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:11.093107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:11.093790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:11.094414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:11.247371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:11.255170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7b879145-1971-4958-bb90-4db7588a3924 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.177675 Sep 08 01:18:11.255735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 378/746] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:11 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:11.613698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:11.614229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:11.621466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:11.621958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:11.622420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:11.623626 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:11.624078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:11.624607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:11.802996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:11.811461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1cdc82bd-c298-4466-bbbd-73cd040e57cc tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.202317 Sep 08 01:18:11.812046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 369/747] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:11 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:12.278917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:12.279902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:12.288798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.290348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.291041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.291980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.292668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.293306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.328533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1265174596", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bcd3bfef-d162-43f3-b680-fb8fdd13ce91"}], "security_groups": [{"name": "tempest-securitygroup--1375277984"}], "key_name": "tempest-keypair-522112454", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:12.440720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:12.448567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-739c427e-8991-4288-8542-b97267652c3a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.173481 Sep 08 01:18:12.449147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 379/748] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:12 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:12.507828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] validate_networks() for [('bcd3bfef-d162-43f3-b680-fb8fdd13ce91', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:18:12.834981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:12.835597 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:12.841662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.842263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.842987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.843691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.844163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.844600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.954531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:18:12.955613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:18:12.955613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:18:12.955950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:18:12.956406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:18:12.965558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.966037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.966471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.967855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:12.968427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:12.968855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:12.977908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:12.986080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-06505081-938e-4d03-af3e-1f70467d994c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.155246 Sep 08 01:18:12.986568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:18:12.987035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 380/749] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:12 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:12.990684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Getting quotas for user 9f2e208a67d4443eb00c75c60c54173f and project 34623908736a4e3d9f015fc9db90bd0d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:18:13.001760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:18:13.004051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:18:13.016018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:13.052826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f74e5d7e-c488-44b9-bab5-d98f2a54d26c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.730059 Sep 08 01:18:13.053471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 370/750] 10.222.0.42 () {62 vars in 1188 bytes} [Thu Sep 8 01:18:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 01:18:13.064987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:13.065587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:13.122660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:13.131213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:13.132671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:13.134040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dda90400-c677-4de7-bee9-9b82fd239414 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1281 microversion: 2.20 time: 0.073156 Sep 08 01:18:13.135439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 381/751] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:13 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:13.472575 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:13.473337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:13.479921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:13.480495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:13.480995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:13.481773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:13.482402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:13.483301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:13.693217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:13.702032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-39bde5b0-2a5b-4c5b-ba1e-34141ad17113 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1264 microversion: 2.1 time: 0.232715 Sep 08 01:18:13.702876 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 371/752] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:13 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:14.007787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:14.008427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:14.018310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.018790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.019222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.019905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.020384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.020839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.148043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:14.156253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b064d673-c8af-4c65-9cd1-08b31aacb3b9 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.152241 Sep 08 01:18:14.156823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 382/753] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:14 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:14.158841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:14.159585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:14.165617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.166098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.166563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.167263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.167713 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.168169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.234411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:14.242287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:14.243720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:14.244856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-34b682b7-fd5a-4d73-810e-5d6d56dd2570 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1333 microversion: 2.20 time: 0.090086 Sep 08 01:18:14.245415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 372/754] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:14 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:14.709819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd100bc9-2128-4983-aa24-ba2e6c3c7613", "name": "network-vif-plugged", "status": "completed", "tag": "fc0898bc-c674-41f6-97c5-3e7b9df2ed52"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:14.723957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.724769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.725194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.726741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:14.727427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:14.734752 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.736821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.738361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.739847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.739961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] Creating event network-vif-plugged:fc0898bc-c674-41f6-97c5-3e7b9df2ed52 for instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 on hv-cinder-84773 Sep 08 01:18:14.741769 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.742465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.745381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-7f6ef2e2-7812-4acc-9db9-478340e5aee8 req-eb510d6f-7bb5-4e13-a212-a4ee4b5ddcdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039988 Sep 08 01:18:14.746026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 383/755] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:14.899527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:14.908865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bfaca242-9ed9-473a-94b3-8290fc700980 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1452 microversion: 2.1 time: 0.187318 Sep 08 01:18:14.909414 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 373/756] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:14 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1452 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:14.934330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:14.935062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:14.942110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.942596 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.943036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:14.943806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:14.944298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:14.944725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:15.083633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:15.092370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-da638949-6bc3-4532-b422-c623fa578de7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1452 microversion: 2.1 time: 0.161723 Sep 08 01:18:15.092980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 384/757] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:14 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:15.178889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:15.179514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:15.185678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:15.186264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:15.186698 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:15.187375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:15.187824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:15.188266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:15.272118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:15.273464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:15.280480 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:15.281185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:15.281625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:15.282332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:15.282782 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:15.283205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:15.330547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:15.338401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-19bd1136-8b51-4c2d-ba39-4296d041526e tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.163241 Sep 08 01:18:15.338969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 374/758] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:15 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:15.365224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:15.369263 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:15.377619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:15.379505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:15.380778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c098e5a4-e53b-40ba-8138-75ee9dc5891b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1333 microversion: 2.20 time: 0.113247 Sep 08 01:18:15.381363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 385/759] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:15 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:16.408711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:16.409324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:16.415969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:16.416763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:16.417009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:16.417689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:16.418172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:16.418660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:16.422322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:16.422951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:16.426515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:16.431676 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:16.432168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:16.432610 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:16.433628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:16.434257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:16.434670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:16.496665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:16.506637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:16.508097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:16.509578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ac251709-0cc4-4f1c-8149-4a8e6f15a24d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1333 microversion: 2.20 time: 0.105588 Sep 08 01:18:16.510357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 375/760] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:16 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1333 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:16.699552 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:16.710156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d8fc0b17-0db5-448c-8162-d34127397049 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1318 microversion: 2.1 time: 0.292040 Sep 08 01:18:16.711202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 386/761] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:16 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:17.203375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585aa54c-7191-4b3d-bc77-4adf1090b504", "tag": "15a42ea1-d5cf-46a9-9ba0-f0879233878a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:17.213270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:17.213831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:17.214300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:17.226891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] Creating event network-changed:15a42ea1-d5cf-46a9-9ba0-f0879233878a for instance 585aa54c-7191-4b3d-bc77-4adf1090b504 on hv-cinder-84773 Sep 08 01:18:17.231953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-621beb2e-3702-4944-8873-80aa370ec2b9 req-6b002dde-7ec1-4c3b-84ad-9d8e30d9796f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032742 Sep 08 01:18:17.233620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 376/762] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:17.535643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:17.536279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:17.542702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:17.543178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:17.543619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:17.544333 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:17.544787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:17.545287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:17.608578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:17.616996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:17.618655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:17.619914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-84000307-5410-48ba-96d4-a731f0a0b710 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1339 microversion: 2.20 time: 0.088245 Sep 08 01:18:17.620655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 387/763] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:17 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:17.735019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:17.736301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:17.742647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:17.743124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:17.743549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:17.744397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:17.744897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:17.745486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:18.078657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:18.087318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-13f128da-c034-4146-8161-b0e1e1eb2e14 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1507 microversion: 2.1 time: 0.357309 Sep 08 01:18:18.088173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 377/764] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:17 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:18.110540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa0d10d1-7a87-4289-b46e-64a60075e5e2", "device": "/dev/sdb"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:18.118196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:18.125112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:18.125529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:18.125965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:18.126916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:18.127568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:18.128215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:18.443589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b230930e-62f6-482b-9320-c275255ff37f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "POST /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337322 Sep 08 01:18:18.444399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 388/765] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:18:18 2022] POST /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:18.646068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:18.646673 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:18.653848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:18.655124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:18.655784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:18.656625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:18.657146 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:18.657636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:18.932479 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:18.940968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:18.942931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:18.944162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5f928af1-2de9-4055-974f-4f28f8a59df5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.302306 Sep 08 01:18:18.945106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 378/766] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:18 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:19.481522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:19.492370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:19.492848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:19.493490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:19.505556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] Creating event network-changed:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:18:19.510460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-5ded1ceb-1a49-4233-bd48-c74b1716ce7b req-1f5b4f27-d746-4d56-87a4-2e0551bc2058 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 Sep 08 01:18:19.512388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 389/767] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:19.970337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:19.970859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:19.977320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:19.977797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:19.978227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:19.978945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:19.979388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:19.979808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:20.113198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:20.121248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:20.123315 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:20.124447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0312a6d8-3d77-45be-a3bc-57778447ebd4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.158280 Sep 08 01:18:20.125009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 379/768] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:19 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:21.150193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:21.150882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:21.157692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:21.158171 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:21.158605 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:21.159287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:21.159733 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:21.160170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:21.297472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:21.305889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:21.307318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:21.308449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8c19e684-bb12-4079-81bb-cc1914345c8f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.162999 Sep 08 01:18:21.309004 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 390/769] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:21 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:22.334488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:22.335099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:22.342323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:22.342807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:22.343245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:22.343938 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:22.344426 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:22.344926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:22.472186 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:22.480272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:22.481825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:22.482966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2a443f35-570a-4d42-a5b6-f15dd7ab816d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.152339 Sep 08 01:18:22.483561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 380/770] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:22 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:23.508029 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:23.508911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:23.511673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=16 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:23.518193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.518667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.519093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:23.519770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.520241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.520661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:23.648034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:23.656892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:23.658335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:23.659452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-50b19b88-05eb-453e-96c4-9feb1c184a62 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.155276 Sep 08 01:18:23.660022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 391/771] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:23 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:23.926683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:23.927200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:23.929101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:23.929820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=10 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:23.936409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.936890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.937326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:23.938011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.938461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.938885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:23.963718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-615c4229-669b-4a0c-a58a-c05a579fd5c5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/ips" status: 200 len: 150 microversion: 2.1 time: 0.040855 Sep 08 01:18:23.964304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 381/772] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:18:23 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:23.977633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "324ab12c-2ea4-49db-a0df-6e7972588546"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:23.980007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:23.986364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.986842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.987275 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:23.987955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:23.988439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:23.988862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.066525 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/os-volume_attachments HTTP/1.1 Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 74 Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:18:24.068330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {"volumeAttachment": {"volumeId": "324ab12c-2ea4-49db-a0df-6e7972588546"}} Sep 08 01:18:24.069867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'server_id': '707afd55-651c-49f6-9e30-7121f95a33dd', 'body': {'volumeAttachment': {'volumeId': '324ab12c-2ea4-49db-a0df-6e7972588546'}}} Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:24.070753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:24.072690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 400 to user: Invalid volume: volume 324ab12c-2ea4-49db-a0df-6e7972588546 is already attached to instances: 0def3b08-5561-4931-922e-84d954c7949e {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9ac0b7a2-e839-4a36-a04b-536ead5783af tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096482 Sep 08 01:18:24.074101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 392/773] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:18:23 2022] POST /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:18:24.079335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:24.079835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:24.085744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.086240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.086658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.087339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.087788 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.088251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.113179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:24.115815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:24.189202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c9daa3d-9f24-446d-8a38-e4924ca6ee9c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 204 len: 0 microversion: 2.1 time: 0.113925 Sep 08 01:18:24.189777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 382/774] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:24 2022] DELETE /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:18:24.198066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:24.198668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:24.206279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.206755 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.207195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.207864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.208340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.208759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.340770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:24.348432 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cf31edff-618e-420c-8ade-9c91697a8d65 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1681 microversion: 2.1 time: 0.154255 Sep 08 01:18:24.348984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 393/775] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:24 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:24.685857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:24.686710 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:24.692600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.693085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.693524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.694214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.694666 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.695091 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.767907 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "name": "network-vif-plugged", "status": "completed", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:24.782760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:24.783241 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:24.783664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:24.796215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] Creating event network-vif-plugged:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:18:24.801725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-48312c05-e09b-4c08-8588-2831a363572e req-6407b9b1-4a51-40ca-86de-d99a67210993 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048378 Sep 08 01:18:24.802501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 394/776] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:24.836831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:24.845126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:24.846554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:24.847666 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c44175ad-0f03-4d46-8952-7baf643ff86f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.166762 Sep 08 01:18:24.848263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 383/777] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:24 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:25.372644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:25.373614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:25.380302 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.380787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.381220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:25.381921 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.382375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.382805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:25.514158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:25.521775 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b8524db0-9ad6-4904-9771-cae56b2e1a71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1681 microversion: 2.1 time: 0.153463 Sep 08 01:18:25.522321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 395/778] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:25 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:25.615122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-629112098"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:25.615676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:25.622180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.622729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.623164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:25.623859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.624351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.624781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:25.755975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.network.security_group_api [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Removing security group 904631b4-5ade-41f3-99fe-358cbeaad7e7 from port 3cb46279-f82a-410c-b844-66fe328c5c39 Sep 08 01:18:25.873962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:25.874621 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:25.881069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.881632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.882137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:25.883037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:25.883973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:25.884422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:26.020706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:26.031049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:26.032655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:26.033840 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e3c3e366-9a14-4320-af4d-6905312c9f01 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.164522 Sep 08 01:18:26.034471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 396/779] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:25 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:26.084225 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d7074ac-c464-4000-9950-359f98ef0e7d tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action" status: 202 len: 0 microversion: 2.1 time: 0.472961 Sep 08 01:18:26.084864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 384/780] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:18:25 2022] POST /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:26.095948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:26.119271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:26.119662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:26.120885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:26.135053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] Creating event network-changed:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:18:26.140908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-f400e670-fe10-4d27-a7bc-1abc60c29845 req-d78086b3-99bb-4b35-958e-5340e046ef02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048489 Sep 08 01:18:26.141824 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 397/781] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:26.545914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:26.546521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:26.553496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:26.554248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:26.554778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:26.555566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:26.556358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:26.556956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:26.738159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:26.746092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-79790f3c-41dd-48e0-921c-9aef46fdcd13 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1681 microversion: 2.1 time: 0.204507 Sep 08 01:18:26.746861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 385/782] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:26 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:27.060328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:27.061137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:27.067410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.067982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.068453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.069157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.070177 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.070613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.209820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:27.219114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:27.220575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:27.221691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2aa9d413-e94b-4a32-adcb-e137237bc0cb tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.166284 Sep 08 01:18:27.222244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 398/783] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:27 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:27.303982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:27.304499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:27.311162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.311646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.312083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.312833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.313289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.313854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.439963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lazy-loading 'services' on Instance uuid e38997a0-e878-489c-956a-e79673e43fb5 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:27.750044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e386bf27-c365-4288-8083-e584462901af tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments/e7123e0c-bd2a-4a09-bdeb-f63015c0f611" status: 202 len: 0 microversion: 2.1 time: 0.449753 Sep 08 01:18:27.754125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 386/784] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:18:27 2022] DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments/e7123e0c-bd2a-4a09-bdeb-f63015c0f611 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:27.760253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:27.762856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:27.770950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:27.771886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:27.774039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.775235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.776054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.777034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.777703 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.778360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.779070 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.780051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.782447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.783174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:27.783624 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:27.784049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:27.815878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a57bdb85-df2c-4db3-9ba3-63f1387973ad tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060475 Sep 08 01:18:27.822070 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 399/785] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:27 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:28.058470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:28.067706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1871f9a5-9f35-44f5-aba4-9bb9bcc07feb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1681 microversion: 2.1 time: 0.301128 Sep 08 01:18:28.068599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 387/786] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:27 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1681 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:28.159582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:28.172243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:28.173158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:28.173745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:28.186150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] Creating event network-changed:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:18:28.192574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-bccc0cfa-0135-4451-9e9e-da84916508fd req-83537eb4-5870-4ea9-97e1-adc340e68586 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036479 Sep 08 01:18:28.193366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 400/787] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:28.246530 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:28.247508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:28.261653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:28.262559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:28.263324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:28.263549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:28.264518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:28.265107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:28.593092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:28.602528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:28.604101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:28.605258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cb0ebea8-c492-43e0-be73-6a66e04d4095 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.362902 Sep 08 01:18:28.605813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 388/788] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:28 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:28.831664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:28.834046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:28.840709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:28.841319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:28.841989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:28.842714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:28.843165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:28.843583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:28.876040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1f4a46cb-1e21-4fd6-8708-17db4c7fa763 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049086 Sep 08 01:18:28.876573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 401/789] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:28 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:29.100079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:29.100668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:29.107568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.108050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.108507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.109185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.109630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.110046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.172200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:29.179913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7583e08d-59a5-4b68-80dc-a61cff3e489a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1614 microversion: 2.1 time: 0.083810 Sep 08 01:18:29.180498 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 389/790] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:29 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:29.685785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:29.686469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:29.692719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.693202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.693636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.694334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.694787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.695209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.832900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:29.842390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:29.843873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:29.845067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c7f41a9f-0203-4682-a8fa-d6db6b6101ab tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.218445 Sep 08 01:18:29.845670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 402/791] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:29 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:29.888469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:29.891163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:29.897263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.897820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.898314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.899066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:29.899577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:29.900060 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:29.931106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4d7e6955-08fd-43bd-bf7c-09c31b03a57b tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047329 Sep 08 01:18:29.931662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 390/792] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:29 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:30.205357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:30.205963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:30.208289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707afd55-651c-49f6-9e30-7121f95a33dd", "name": "network-vif-deleted", "tag": "34fff18a-0060-4b00-9710-133c7f049719"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:30.211922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.212440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.212866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.213951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.214073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.214425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.219990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.219990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.219990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.230177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] Creating event network-vif-deleted:34fff18a-0060-4b00-9710-133c7f049719 for instance 707afd55-651c-49f6-9e30-7121f95a33dd on hv-cinder-84773 Sep 08 01:18:30.235636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-1a2b315e-0fd8-4c02-869e-35fe33d0ad00 req-a9ebd574-0dc9-4ccf-8e88-81ddebf81b77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Sep 08 01:18:30.236566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 391/793] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:30.278080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:30.280661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:30.287396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e2767179-108e-4d33-a0d4-e8e82fc76d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1614 microversion: 2.1 time: 0.086903 Sep 08 01:18:30.287970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 403/794] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:30 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:30.870471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:30.871195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:30.878270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.878742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.879169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.879847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.880344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.880764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.943452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:30.945635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:30.953037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.953788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.954217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.954911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:30.955358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:30.955777 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:30.987042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-31d30046-da2c-4208-95a9-5435f0da7542 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047927 Sep 08 01:18:30.987608 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 404/795] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:30 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:31.011370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:31.019326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:31.020795 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:31.021889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-92898a4b-dc6b-42d1-bce3-677edae2262e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.155676 Sep 08 01:18:31.022441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 392/796] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:30 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:31.310716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:31.311315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:31.317358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:31.317822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:31.318246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:31.318922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:31.319363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:31.319778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:31.381422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:31.389940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0649a32d-f453-4646-8b8b-031eafbf1746 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1614 microversion: 2.1 time: 0.083040 Sep 08 01:18:31.390489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 405/797] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:31 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:32.000114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:32.002280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:32.008931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.009411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.009851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.010542 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.010994 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.011418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.042780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-14af1548-e51f-4a14-8327-45f7eb402bea tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047236 Sep 08 01:18:32.043345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 393/798] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:31 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:32.047370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:32.047970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:32.054393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.054867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.055291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.055971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.056489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.056911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.260207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:32.278192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:32.280271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:32.281451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-58ee3f6c-a44a-483e-beb3-3764ea4849ce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1407 microversion: 2.20 time: 0.238476 Sep 08 01:18:32.282025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 406/799] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:32 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:18:32.413643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:32.414400 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:32.423254 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.423732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.424180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.424871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:32.425321 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:32.425739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:32.493989 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:32.502526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9edfcbe7-4fb9-456b-b84f-e354a08f62a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1326 microversion: 2.1 time: 0.092688 Sep 08 01:18:32.503094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 394/800] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:32 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:33.055016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:33.057955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:33.064927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.065402 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.065837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.066521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.066970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.067387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.099367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-99a61249-1e6a-47a1-bd18-29cd8a0af644 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048322 Sep 08 01:18:33.099929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 407/801] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:33 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:33.307068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:33.307923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:33.314914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.315397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.315833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.316565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.317022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.317444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.446382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:33.455386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:33.456846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:33.458009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-870c6402-cb9f-4f9d-8534-f3fd16df2a03 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1600 microversion: 2.20 time: 0.155414 Sep 08 01:18:33.458563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 395/802] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:18:33 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1600 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:18:33.486299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:33.486783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:33.492646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.493119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.493549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.494227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.494879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.495622 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.526943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:33.527578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:33.535192 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.535680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.536124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.536851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:33.537303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:33.537756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:33.583480 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3c181bc7-607f-42be-a4ed-63db57610693 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101375 Sep 08 01:18:33.584184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 408/803] 10.222.0.42 () {60 vars in 1316 bytes} [Thu Sep 8 01:18:33 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:18:33.612382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:33.625359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-23a83071-91b6-4260-8077-5d9bb931d25e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1326 microversion: 2.1 time: 0.101397 Sep 08 01:18:33.626040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 396/804] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:33 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1326 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:34.114477 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:34.116674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:34.123444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:34.123940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:34.124413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:34.125122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:34.125580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:34.126005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:34.159362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6f088c67-758a-4dc3-aa14-42d826fa5fe3 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049370 Sep 08 01:18:34.159963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 409/805] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:34 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:34.650975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:34.651602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:34.658172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:34.658657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:34.659092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:34.659786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:34.660264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:34.660694 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:34.717030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:34.728997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:34.729786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:34.730217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:34.734738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:34.742214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] Creating event network-changed:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:18:34.743369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3288dafc-6ce6-46e8-a3e8-f18dffcda4c0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1326 microversion: 2.1 time: 0.097646 Sep 08 01:18:34.744411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 397/806] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:34 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1326 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:34.750829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-e084be65-1d01-40fb-adba-7593fbf37e71 req-73b7a0fc-aa80-4950-a9b4-6f679e2c1971 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038037 Sep 08 01:18:34.752363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 410/807] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:35.172933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:35.175537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:35.183164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:35.183709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:35.184077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:35.185823 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:35.186437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:35.186862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:35.191613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:35.223201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-459653a0-c66a-4b00-8efd-8db4907fbc20 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054900 Sep 08 01:18:35.224219 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 398/808] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:35 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:35.769870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:35.771503 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:35.774854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:35.779389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:35.780279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:35.780728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:35.781446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:35.781894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:35.782504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:35.844679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:35.845155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:35.845640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:35.846103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid 707afd55-651c-49f6-9e30-7121f95a33dd {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:35.899644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:35.909917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-460d5846-0658-4183-b7e1-6e2142dd6d27 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 200 len: 1331 microversion: 2.1 time: 0.144892 Sep 08 01:18:35.911714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 411/809] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:35 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 1331 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:36.240583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:36.246043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:36.264329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:36.264983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:36.265678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:36.266865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:36.267485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:36.268209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:36.306857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bd788268-45c3-444e-b487-1f5c5213c71e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075747 Sep 08 01:18:36.307781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 399/810] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:36 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:36.940289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:36.940979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:36.949973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:36.950870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:36.951811 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:36.952810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:36.953366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:36.953930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:36.971775 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd HTTP/1.1 Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:18:36.973841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:18:36.975292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '707afd55-651c-49f6-9e30-7121f95a33dd'} Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:36.976062 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:18:36.981360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:18:36.982749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:36.982749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-361e3be2-b239-425e-9eec-8786ee169d38 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 404 len: 111 microversion: 2.1 time: 0.041980 Sep 08 01:18:36.982749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 412/811] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:36 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:18:36.988570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6012c376-7ee6-4210-a70c-0f96e68aede2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '.version_select at 0x7fe9c9b0a4c0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:37.013194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6012c376-7ee6-4210-a70c-0f96e68aede2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746750676" status: 202 len: 0 microversion: 2.1 time: 0.028186 Sep 08 01:18:37.014251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 400/812] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 8 01:18:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1746750676 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:37.320169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:37.322611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:37.344100 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.345072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.345669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.346546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.347147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.347729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.379593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5fd66e84-75f7-47a0-8126-19d41826074f tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063231 Sep 08 01:18:37.380820 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 413/813] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:37 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:18:37.393475 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:37.394098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:37.402159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.402760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.403945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.405014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.405543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.406042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.610103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] HTTP exception thrown: Instance e38997a0-e878-489c-956a-e79673e43fb5 is not attached to volume e7123e0c-bd2a-4a09-bdeb-f63015c0f611 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Request method failure captured: Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments/e7123e0c-bd2a-4a09-bdeb-f63015c0f611 HTTP/1.1 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIQBcJDCLoDQXCbg0dudsRDhFGCdbs_qunFohzFyvKWb4P2d4fZ1xM2q-h97aAGn2MUFrQvv99T5XmKtRlzkF8Uv8uRUw57KSb9rIzCt-soaNdQKHzkB8yzen6dPRmxxiNLS4cj1B5X68crLak0DPYMteZbgYWxqionvH-qz_Loi5s Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 275f1c82d4f34cbfa81591e5f5a13f63 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:18:37.626527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/275f1c82d4f34cbfa81591e5f5a13f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/275f1c82d4f34cbfa81591e5f5a13f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_275f1c82d4f34cbfa81591e5f5a13f63", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/275f1c82d4f34cbfa81591e5f5a13f63"}]}] Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 275f1c82d4f34cbfa81591e5f5a13f63 Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-TestMinimumBasicScenario-376069701-project Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 5411bb3267704943aea31c4bf1b4c9d1 Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestMinimumBasicScenario-376069701-project Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:18:37.628365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance e38997a0-e878-489c-956a-e79673e43fb5 is not attached to volume e7123e0c-bd2a-4a09-bdeb-f63015c0f611 Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'server_id': 'e38997a0-e878-489c-956a-e79673e43fb5', 'id': 'e7123e0c-bd2a-4a09-bdeb-f63015c0f611'} Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7123e0c-bd2a-4a09-bdeb-f63015c0f611. Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:37.629216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38997a0-e878-489c-956a-e79673e43fb5 is not attached to volume e7123e0c-bd2a-4a09-bdeb-f63015c0f611 Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38997a0-e878-489c-956a-e79673e43fb5 is not attached to volume e7123e0c-bd2a-4a09-bdeb-f63015c0f611 Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:37.634269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Returning 404 to user: Instance e38997a0-e878-489c-956a-e79673e43fb5 is not attached to volume e7123e0c-bd2a-4a09-bdeb-f63015c0f611 {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:37.635317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-648379e7-1ced-447c-9cf2-a360f37ed870 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments/e7123e0c-bd2a-4a09-bdeb-f63015c0f611" status: 404 len: 154 microversion: 2.1 time: 0.241327 Sep 08 01:18:37.635317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 401/814] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:18:37 2022] DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5/os-volume_attachments/e7123e0c-bd2a-4a09-bdeb-f63015c0f611 => generated 154 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:18:37.738261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:37.739110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:37.746450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.746971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.747414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.748111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.748588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.749016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.846208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'services' on Instance uuid 0def3b08-5561-4931-922e-84d954c7949e {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:37.933344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ec70cd67-c62c-4e64-9770-76222975bfaa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments/324ab12c-2ea4-49db-a0df-6e7972588546" status: 202 len: 0 microversion: 2.1 time: 0.199361 Sep 08 01:18:37.933999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 414/815] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:18:37 2022] DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments/324ab12c-2ea4-49db-a0df-6e7972588546 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:37.950046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:37.952603 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:37.959309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.959799 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.960267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.960966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:37.961410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:37.961840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:37.993271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e228b3f8-dcf5-48fb-b4b4-7e488fa30c0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053426 Sep 08 01:18:37.993839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 402/816] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:37 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:38.790616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:38.791196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:38.798370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:38.798855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:38.799296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:38.799994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:38.800472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:38.800895 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:38.828493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:38.915810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cadb13a7-5129-495c-ae68-a2bb144889fb tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 204 len: 0 microversion: 2.1 time: 0.132351 Sep 08 01:18:38.916713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 415/817] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:38 2022] DELETE /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:18:38.925396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:38.926062 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:38.933528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:38.934486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:38.935107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:38.936742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:38.937208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:38.937809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:39.011818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:39.015182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:39.024918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:39.026033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:39.026475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:39.032648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:39.038637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:39.038637 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:39.083695 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9222cf94-3bc6-472f-99ca-769261edaae4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079954 Sep 08 01:18:39.084282 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 416/818] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:39 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:39.091822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:39.101245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d47f7b89-fc68-4cb5-8a3e-8ca5a2039815 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1555 microversion: 2.1 time: 0.180130 Sep 08 01:18:39.101793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 403/819] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:38 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1555 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:40.096332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:40.096831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:40.097236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:40.098520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:40.103382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.103862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.104333 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.105028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.105129 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.105481 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.105588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.105904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.106004 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.107067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.107515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.107940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.138495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-991f5547-b6a8-491b-b20e-621429b919f9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045427 Sep 08 01:18:40.139074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 404/820] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:40 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:40.144675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:40.145279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:40.151267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.151739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.152183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.152868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:40.153573 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:40.154140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:40.191603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lazy-loading 'services' on Instance uuid cd100bc9-2128-4983-aa24-ba2e6c3c7613 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:40.271728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9adadb72-1ccf-497a-8d11-b029ecb35a01 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613/os-volume_attachments/fa0d10d1-7a87-4289-b46e-64a60075e5e2" status: 202 len: 0 microversion: 2.1 time: 0.179109 Sep 08 01:18:40.272476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 417/821] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:18:40 2022] DELETE /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613/os-volume_attachments/fa0d10d1-7a87-4289-b46e-64a60075e5e2 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:40.296905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:40.304766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8309ed75-4335-4e30-a154-33a84fae8e24 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1555 microversion: 2.1 time: 0.164739 Sep 08 01:18:40.305335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 405/822] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:40 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:41.154027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:41.156287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:41.162403 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.162884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.163319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.164008 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.164483 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.164908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.191992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:41.196829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e7744a0-a930-4995-bbdd-bb717bec3d7c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049702 Sep 08 01:18:41.197391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 418/823] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:41 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:18:41.269072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:41.270047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:41.276972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.277458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.277917 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.279238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.279725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.280173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.311041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:41.339972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:41.341668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:41.352011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.352599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.353317 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.354014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.354628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.355502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.396095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c402b70b-e2d4-42ab-840c-8bf07b8aae39 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 204 len: 0 microversion: 2.1 time: 0.131499 Sep 08 01:18:41.396891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 406/824] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:41 2022] DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:18:41.412677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:41.412677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:41.415376 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.416055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.416515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.417218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:41.417672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:41.418095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:41.504077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:41.512315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6b2b5b09-cc77-495e-837d-1b36e48af580 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1555 microversion: 2.1 time: 0.177191 Sep 08 01:18:41.513061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 419/825] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:41 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:41.549519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:41.557345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cc9eba16-9ec6-4b63-b88e-ef3d2cf9c761 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1682 microversion: 2.1 time: 0.156276 Sep 08 01:18:41.557846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 407/826] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:41 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:42.535505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:42.536107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:42.542533 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:42.543031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:42.543465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:42.544536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:42.544990 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:42.545413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:42.581138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:42.581747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:42.588499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:42.588985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:42.589422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:42.590114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:42.590596 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:42.591089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:42.678618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:42.687153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6174dabc-5ff1-43a1-a157-cfb25a0cde34 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1555 microversion: 2.1 time: 0.155452 Sep 08 01:18:42.687732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 420/827] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:42 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:42.725261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:42.733457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b9d908be-076f-46c7-adfa-4a8889043b45 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1682 microversion: 2.1 time: 0.156253 Sep 08 01:18:42.734025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 408/828] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:42 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:43.710542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:43.711160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:43.718306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:43.718783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:43.719217 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:43.719905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:43.720400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:43.720826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:43.757561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:43.758164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:43.760891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:43.767139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:43.767633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:43.768066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:43.768792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:43.769245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:43.769675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:43.851196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:43.859239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-16a7eb68-5905-4338-89d7-bfc5ba202c92 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1555 microversion: 2.1 time: 0.152604 Sep 08 01:18:43.859821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 421/829] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:43 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:43.901733 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:43.909597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b80d9667-bef0-4241-8c11-a863ebc65d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1682 microversion: 2.1 time: 0.155885 Sep 08 01:18:43.910159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 409/830] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:43 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:44.819260 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e38997a0-e878-489c-956a-e79673e43fb5", "name": "network-vif-deleted", "tag": "3cb46279-f82a-410c-b844-66fe328c5c39"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:44.832736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:44.832977 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:44.833961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:44.860740 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] Creating event network-vif-deleted:3cb46279-f82a-410c-b844-66fe328c5c39 for instance e38997a0-e878-489c-956a-e79673e43fb5 on hv-cinder-84773 Sep 08 01:18:44.865920 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a1a64cdc-3a41-429c-b0ed-703267cd1d8d req-e4ecf269-d2da-4191-ad9e-3b7eaaa2b738 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050317 Sep 08 01:18:44.866751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 422/831] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:18:44.883118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:44.884006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:44.893125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:44.893616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:44.894044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:44.894773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:44.895602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:44.896658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:44.933661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:44.934569 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:44.940718 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:44.941188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:44.941614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:44.942295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:44.942742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:44.943159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:44.966187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5411bb3267704943aea31c4bf1b4c9d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '275f1c82d4f34cbfa81591e5f5a13f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:44.975017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-17ccb969-7fe1-43fa-966d-e32aacee0e3e tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 200 len: 1343 microversion: 2.1 time: 0.096009 Sep 08 01:18:44.975572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 410/832] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:44 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 1343 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:45.092819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:45.101601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb04043c-3544-4c1d-b4f7-7ce99e7d1d34 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1682 microversion: 2.1 time: 0.171995 Sep 08 01:18:45.111374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 423/833] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:44 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:45.683412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:45.686271 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:45.695687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:45.696840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:45.697473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:45.698398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:45.698852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:45.699273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:45.725693 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:45.828024 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-997ccf71-7f2d-4490-a1d9-6b93a0c9c82c tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 204 len: 0 microversion: 2.1 time: 0.153265 Sep 08 01:18:45.829618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 411/834] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:45 2022] DELETE /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:18:45.841787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:45.842709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:45.850497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:45.851366 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:45.852712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:45.853686 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:45.854291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:45.854866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:45.999733 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:46.000664 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] [instance: e38997a0-e878-489c-956a-e79673e43fb5] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:46.006917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:46.012239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.013463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.014113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.014874 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.015362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.015601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7cb852e3-7f92-4155-b239-c94a15cfa7ef tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1513 microversion: 2.1 time: 0.181514 Sep 08 01:18:46.016073 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.020234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 424/835] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:45 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:46.030899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] HTTP exception thrown: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Request method failure captured: Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 HTTP/1.1 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIQBcJDCLoDQXCbg0dudsRDhFGCdbs_qunFohzFyvKWb4P2d4fZ1xM2q-h97aAGn2MUFrQvv99T5XmKtRlzkF8Uv8uRUw57KSb9rIzCt-soaNdQKHzkB8yzen6dPRmxxiNLS4cj1B5X68crLak0DPYMteZbgYWxqionvH-qz_Loi5s Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 275f1c82d4f34cbfa81591e5f5a13f63 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:18:46.032620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/275f1c82d4f34cbfa81591e5f5a13f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/275f1c82d4f34cbfa81591e5f5a13f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_275f1c82d4f34cbfa81591e5f5a13f63", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/275f1c82d4f34cbfa81591e5f5a13f63"}]}] Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 275f1c82d4f34cbfa81591e5f5a13f63 Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestMinimumBasicScenario-376069701 Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-TestMinimumBasicScenario-376069701-project Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 5411bb3267704943aea31c4bf1b4c9d1 Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestMinimumBasicScenario-376069701-project Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. Sep 08 01:18:46.034236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'e38997a0-e878-489c-956a-e79673e43fb5'} Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:46.035069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. Sep 08 01:18:46.036707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:46.037985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Returning 404 to user: Instance e38997a0-e878-489c-956a-e79673e43fb5 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:46.037985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6b2855c5-d5ea-4146-91bb-c0acb91b7070 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5" status: 404 len: 111 microversion: 2.1 time: 0.039404 Sep 08 01:18:46.037985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 412/836] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:45 2022] GET /compute/v2.1/servers/e38997a0-e878-489c-956a-e79673e43fb5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:18:46.042978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fd620b79-d6ab-4b9f-a41b-ed49edd064f2 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] Calling method '.version_select at 0x7fe9c9a1af70>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:46.063301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fd620b79-d6ab-4b9f-a41b-ed49edd064f2 tempest-TestMinimumBasicScenario-376069701 tempest-TestMinimumBasicScenario-376069701-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1471928182" status: 202 len: 0 microversion: 2.1 time: 0.023843 Sep 08 01:18:46.063898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 425/837] 10.222.0.42 () {58 vars in 1272 bytes} [Thu Sep 8 01:18:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1471928182 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:46.134687 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:46.135478 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:46.142846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.143396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.144016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.145089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.145647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.146081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.151347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:46.191384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.191854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.192501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.192946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid 0def3b08-5561-4931-922e-84d954c7949e {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:46.238356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:46.247638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-37eecc01-1501-4ef8-9810-763086a3ba61 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1332 microversion: 2.1 time: 0.124615 Sep 08 01:18:46.248459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 413/838] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:46 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:46.884159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0def3b08-5561-4931-922e-84d954c7949e", "name": "network-vif-deleted", "tag": "ea84e823-ad97-4efb-b4c3-42cdbf5d23df"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:46.893983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:46.894451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:46.894871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:46.905864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] Creating event network-vif-deleted:ea84e823-ad97-4efb-b4c3-42cdbf5d23df for instance 0def3b08-5561-4931-922e-84d954c7949e on hv-cinder-84773 Sep 08 01:18:46.910645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-89030d0d-b1d0-4037-8e1f-3e9c0e2941f2 req-36575373-0aa0-42f9-ac73-4bbcd2180bdc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030798 Sep 08 01:18:46.911221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 426/839] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:47.038833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:47.039479 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:47.046354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:47.046828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:47.047258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:47.047940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:47.048415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:47.048841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:47.188794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:47.200344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9464c609-bf7a-4fe2-b192-6114c72f1a7a tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1513 microversion: 2.1 time: 0.164721 Sep 08 01:18:47.200926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 414/840] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:47 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:47.273235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:47.273931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:47.280953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:47.281430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:47.281857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:47.282548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:47.282993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:47.283410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:47.314485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:47.314959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:47.315382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:47.315821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid 0def3b08-5561-4931-922e-84d954c7949e {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:47.367980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:47.376046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2181c71c-726e-41f3-8f29-af91cbdfe6a5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1332 microversion: 2.1 time: 0.107811 Sep 08 01:18:47.376654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 427/841] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:47 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:48.109570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:48.110113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:48.116235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.116749 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.117188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.117881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.118340 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.118773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.224438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'services' on Instance uuid 3e6b6b63-526f-482b-90ec-27c0b4d858a7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:48.224690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:48.225373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:48.245982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.246768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.247379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.248174 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.248754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.249293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.322933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9ccbcf3f-3714-441a-ad67-9f9123e4ad89 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments/f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605" status: 202 len: 0 microversion: 2.1 time: 0.217870 Sep 08 01:18:48.327639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 415/842] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:18:48 2022] DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments/f35a94e1-7d07-4cd9-b1cc-2b87b1fd8605 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:18:48.333355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:48.335712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:48.344700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.345219 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.345656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.346347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.346963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.347939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.383843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ca2307b2-55e2-4cc7-ac24-eae84c54041f tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054261 Sep 08 01:18:48.384665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 416/843] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:48 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:48.401156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:48.404170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:48.420417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.421134 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.421773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.422643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.423248 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.423824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.443709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:48.459048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7a10a0e0-ae5a-4cd5-bc04-9db26c1d7ed1 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1513 microversion: 2.1 time: 0.232490 Sep 08 01:18:48.459949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 428/844] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:48 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1513 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:48.469900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:48.470844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:48.471493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:48.472088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid 0def3b08-5561-4931-922e-84d954c7949e {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:18:48.538040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:48.547322 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9847abe8-867c-4045-bdb5-60822d3c6ae8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 200 len: 1332 microversion: 2.1 time: 0.150411 Sep 08 01:18:48.548097 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 417/845] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:48 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 1332 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:49.393873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd100bc9-2128-4983-aa24-ba2e6c3c7613", "name": "network-vif-deleted", "tag": "fc0898bc-c674-41f6-97c5-3e7b9df2ed52"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:49.400074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:49.403354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:49.410999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.411738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.412474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.412838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.413311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.413732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.414073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.421668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.422393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.431657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] Creating event network-vif-deleted:fc0898bc-c674-41f6-97c5-3e7b9df2ed52 for instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 on hv-cinder-84773 Sep 08 01:18:49.439502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9b744ea1-be7f-4725-a286-ac8f39751fb0 req-1fb4f97a-004c-4a6d-94dd-61353d91a994 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054335 Sep 08 01:18:49.440117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 429/846] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:49.471032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0cf83b30-27e4-458b-9fc5-478d882585bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075342 Sep 08 01:18:49.471882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 418/847] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:49 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:49.484025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:49.484769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:49.493139 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.493830 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.494453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.495334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.495954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.496630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.576562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:49.578362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:49.587310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '336e7f07cd7d461c8257995a772ac1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93477e5edb38498ba32feb52519ba584', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:49.591273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.591754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.592408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.593930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:49.596683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cd9c1d8d-f791-4907-94df-266addd90856 tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 200 len: 1303 microversion: 2.1 time: 0.117353 Sep 08 01:18:49.602956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:49.603495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:49.610133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 430/848] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:49 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:49.634941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e HTTP/1.1 Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:18:49.637551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:18:49.639183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '0def3b08-5561-4931-922e-84d954c7949e'} Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:49.640058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:18:49.641540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:49.645139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:49.646167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-132b5fc2-14c4-4cf0-8828-699968dfca0b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 404 len: 111 microversion: 2.1 time: 0.079618 Sep 08 01:18:49.650894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 419/849] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:49 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:18:49.656949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2bdaa69d-579f-4424-9c5c-c1946fd0737e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '.version_select at 0x7fe9c9a39c10>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:49.679518 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2bdaa69d-579f-4424-9c5c-c1946fd0737e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857616494" status: 202 len: 0 microversion: 2.1 time: 0.027952 Sep 08 01:18:49.680101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 431/850] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 8 01:18:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857616494 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:18:50.484733 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.486885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.501083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.501566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.502005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.502794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.503287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.503723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.541247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-61077fde-c2eb-4147-a185-0c27c3cfdbe6 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061057 Sep 08 01:18:50.541816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 420/851] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:50 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:18:50.565835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.567959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.576300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.577023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.577633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.578641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.579253 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.579836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.617441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-270a2fbb-57fa-4c56-926d-6bcff400ef2e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055616 Sep 08 01:18:50.620682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.622430 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] [instance: cd100bc9-2128-4983-aa24-ba2e6c3c7613] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.629123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.629822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.630429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.631334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.631934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.632704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.633102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 432/852] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:18:50 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:18:50.670701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.670939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] HTTP exception thrown: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Request method failure captured: Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 HTTP/1.1 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUJZ4l_ACWFf-jc3Yh8NtzNzj3CFFyEXLv6oQ7vKK273tMDKBhYWRxYdFr0aPMD1vh-e2SAeKOs_7GywpgmRrFTHr0ekvJ1bi7bJEEZyrgsEDXJ1OoDYPnlbBcMJ7yrlg3yvJo5yt18Cnj-2zN7ZgTECkuSaf5ezJdGagm7cf1ThapM Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 93477e5edb38498ba32feb52519ba584 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:18:50.672565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93477e5edb38498ba32feb52519ba584"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93477e5edb38498ba32feb52519ba584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93477e5edb38498ba32feb52519ba584", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93477e5edb38498ba32feb52519ba584"}]}] Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 93477e5edb38498ba32feb52519ba584 Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1726091172 Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotTestJSON-1726091172-project Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 336e7f07cd7d461c8257995a772ac1f0 Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotTestJSON-1726091172-project Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. Sep 08 01:18:50.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'cd100bc9-2128-4983-aa24-ba2e6c3c7613'} Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:18:50.675031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. Sep 08 01:18:50.676247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:18:50.678754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.680066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] Returning 404 to user: Instance cd100bc9-2128-4983-aa24-ba2e6c3c7613 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:18:50.681181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7207fd85-7e0c-417b-b0ec-1ae7e308c72f tempest-VolumesSnapshotTestJSON-1726091172 tempest-VolumesSnapshotTestJSON-1726091172-project] 10.222.0.42 "GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613" status: 404 len: 111 microversion: 2.1 time: 0.065095 Sep 08 01:18:50.682237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 421/853] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:50 2022] GET /compute/v2.1/servers/cd100bc9-2128-4983-aa24-ba2e6c3c7613 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:18:50.689991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.691006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.691693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.692716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.693640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.694926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.735914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.736779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.742677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.743172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.743608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.744333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.744972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.745976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.746116 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:50.776606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:18:50.890235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-56d49299-3b0a-43a7-b677-cac7ee89b895 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 204 len: 0 microversion: 2.1 time: 0.219479 Sep 08 01:18:50.891332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 433/854] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:50 2022] DELETE /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:18:50.898601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6442895d-4e4b-4347-9a02-fbe484e739e1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: .version_select at 0x7fe9c9a285e0>, body: {"keypair": {"name": "tempest-keypair-351030552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrx9pOT386Dh8GGA7tP8ywFgwmO4tETkPMxwc8mC8OVuapFDNodd/t//S5uPPJCIbULfJZ8nqgYAhXlHQjMu3+9FIVrYcIKO510VR+qODLjDfSBdSVULXoynQ0LFWDk8w=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:50.925501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-6442895d-4e4b-4347-9a02-fbe484e739e1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:18:50.933148 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-6442895d-4e4b-4347-9a02-fbe484e739e1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:18:50.941886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a429af0c-b7e6-4082-83ef-08cc49dcd082 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 204 len: 0 microversion: 2.1 time: 0.209597 Sep 08 01:18:50.942736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 422/855] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:18:50 2022] DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 01:18:50.953825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.954954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.961584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.962234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.962711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.963436 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:50.963893 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:50.964374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:50.980870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6442895d-4e4b-4347-9a02-fbe484e739e1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.087416 Sep 08 01:18:50.982818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 434/856] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:18:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:18:50.989167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:50.990409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:50.999780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:51.000641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:51.001565 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:51.003123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:51.003877 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:51.004634 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:51.207295 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:51.216791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5cdc6c44-bb10-4731-99d5-f805a45dd1d1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.268835 Sep 08 01:18:51.217592 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 423/857] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:50 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:51.423699 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:51.433106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ce3c7f64-dc2c-476f-9315-041662163298 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.448555 Sep 08 01:18:51.434506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 435/858] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:50 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:52.241449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:52.242051 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:52.249991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:52.251114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:52.251761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:52.252942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:52.254010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:52.254669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:52.460644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:52.461930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:52.472648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:52.474095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:52.475173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:52.476101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:52.476726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:52.477708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:52.499316 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:52.527813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-540724dc-1408-46e0-9ee4-a7dc068565ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.289918 Sep 08 01:18:52.529605 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 424/859] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:52 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:52.673787 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-394862935", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e9407ec-0cf4-40eb-abcb-b44e26ace243"}], "security_groups": [{"name": "tempest-securitygroup--728559531"}], "key_name": "tempest-keypair-351030552", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:18:52.676305 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:52.684394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa9f1495-b51a-4730-bc14-fd22f1b89dec tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.229331 Sep 08 01:18:52.685396 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 436/860] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:52 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:52.848954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] validate_networks() for [('9e9407ec-0cf4-40eb-abcb-b44e26ace243', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:18:53.424817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:18:53.425302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:18:53.425892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:18:53.426313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:18:53.426733 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:18:53.441811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.442895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.443503 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.444458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.445406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.446486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.475444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:18:53.480231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:18:53.492583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:18:53.494738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:18:53.550620 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ddca124d-8d6d-47da-a211-283fe80ee48e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.883048 Sep 08 01:18:53.551429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 425/861] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:18:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 01:18:53.565528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-872e8c35-b2b7-4b95-bf12-7c332bb93109 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:53.566670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-872e8c35-b2b7-4b95-bf12-7c332bb93109 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:53.567134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:53.567760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:53.581535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.582028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.585375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.586332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.588964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.590134 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.652565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-872e8c35-b2b7-4b95-bf12-7c332bb93109 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:53.660026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-872e8c35-b2b7-4b95-bf12-7c332bb93109 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1240 microversion: 2.1 time: 0.098700 Sep 08 01:18:53.676317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 426/862] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:53 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:53.711435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:53.712063 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:53.721518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.722209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.722667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.723403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:53.724938 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:53.725379 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:53.891646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:53.901078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dd855a31-77d8-4b87-96f0-4fbc78ab3c81 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.339834 Sep 08 01:18:53.901865 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 437/863] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:53 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:53.902537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:53.912504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-118c3ae8-5a96-44f3-911f-88068997ac8e tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.206565 Sep 08 01:18:53.924251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 427/864] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:53 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:54.687350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:54.687975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:54.694476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.694981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.695656 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:54.696126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.696598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.697119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:54.712097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:54.798502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:54.808272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4d69ce7f-f7b9-4779-9a06-e043d12e783c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1244 microversion: 2.1 time: 0.125129 Sep 08 01:18:54.828232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 438/865] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:54 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1244 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:54.927391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:54.928471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:54.936978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.937691 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.938481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:54.939056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:54.939679 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:54.939962 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.941921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.942361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:54.950989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.952825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.953913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:54.956374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:54.957184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:54.957674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:55.130960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:55.140865 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cbb528ab-ad58-49b3-beb8-ff961ac5dcd2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.206762 Sep 08 01:18:55.141751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 439/866] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:54 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:55.207724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:55.216045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-780234bc-c909-4244-bfe2-4a9e1f5f83b1 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.293270 Sep 08 01:18:55.216584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 428/867] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:54 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:55.851048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:55.851676 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:55.864385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:55.864899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:55.865325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:55.866047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:55.866537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:55.868717 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:55.949477 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:55.958418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-566d8fde-aaba-4c50-96cd-b4d1a8c8774d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1244 microversion: 2.1 time: 0.128255 Sep 08 01:18:55.959230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 440/868] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:55 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1244 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:56.164550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:56.165157 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:56.172164 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.172665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.173288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:56.174019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.174466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.175112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:56.240856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:56.241498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:56.247993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.248720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.249150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:56.249853 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.250311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.250770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:56.328009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:56.332430 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:56.339482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-455cf866-6128-4176-bbd9-650e3651f4f3 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.178658 Sep 08 01:18:56.340943 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 429/869] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:56 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:56.405949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:56.416065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f6849824-64fc-405a-b6cd-a5fd411213bc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.179594 Sep 08 01:18:56.424172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 441/870] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:56 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:56.983344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:56.984040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:56.991599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.992089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.993193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:56.993895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:56.994347 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:56.994770 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:57.061185 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:57.068946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8beec51e-7852-4546-a1b8-4bc074560bf0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1244 microversion: 2.1 time: 0.090247 Sep 08 01:18:57.069528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 430/871] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:56 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:57.364715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:57.365329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:57.372096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:57.372609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:57.373049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:57.373781 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:57.374245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:57.374672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:57.441912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:57.442529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:57.450428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:57.450965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:57.451670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:57.452439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:57.453235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:57.453702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:57.514314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:57.524912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-08067f48-cd60-4919-91db-214b2796faa1 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.163944 Sep 08 01:18:57.526340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 442/872] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:57 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:57.604547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:57.612583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-841dbe51-43dc-48e8-a71b-91191253a044 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.174556 Sep 08 01:18:57.613141 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 431/873] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:57 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:58.093424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:58.094169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:58.100334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.100947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.101387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.102084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.102535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.102958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.170958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:58.178310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-769bafcb-ffcd-46a0-a605-c0dd1737a587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1292 microversion: 2.1 time: 0.089803 Sep 08 01:18:58.179406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 443/874] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:58 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:58.550137 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:58.550755 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:58.557085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.557567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.558003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.559280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.559740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.560196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.637715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:58.638460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:58.645032 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.645517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.646878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.648476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:58.649078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:58.650039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:58.886965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:58.896839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-47755a65-463a-4385-b8ef-bc5cdac7e186 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1685 microversion: 2.1 time: 0.264047 Sep 08 01:18:58.897420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 444/875] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:58 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1685 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:18:58.908452 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:58.926014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9248f9ee-c378-42e4-914f-3c768834a16a tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1675 microversion: 2.1 time: 0.379478 Sep 08 01:18:58.941145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 432/876] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:58 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1675 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:59.204015 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:59.204929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:59.211342 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:59.212105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:59.212857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:59.213729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:59.214328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:59.214900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:59.301988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:18:59.310665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1970fca6-b9df-4261-b945-1555c9a19a4a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1298 microversion: 2.1 time: 0.111516 Sep 08 01:18:59.311928 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 445/877] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:59 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1298 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:18:59.923310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:18:59.928408 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:18:59.940562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:18:59.954272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:59.954783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:59.955274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:18:59.955947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:18:59.957725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:18:59.961264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.110952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:00.119060 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a13c9a4f-69dd-4442-8a6e-742e594a5522 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1329 microversion: 2.1 time: 0.201235 Sep 08 01:19:00.127804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 446/878] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:18:59 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1329 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:00.152049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:00.154738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:00.173809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:00.174685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:00.175343 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.176505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:00.177318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:00.180750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.216476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e6b6b63-526f-482b-90ec-27c0b4d858a7", "name": "network-vif-deleted", "tag": "925981bc-72bc-4895-90e7-3e5169b05c04"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:00.240081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:00.240589 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:00.241018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.268820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] Creating event network-vif-deleted:925981bc-72bc-4895-90e7-3e5169b05c04 for instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 on hv-cinder-84773 Sep 08 01:19:00.281008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-e251839b-149f-4e87-a1bf-a7d463bae9ca req-1a5dc78c-b9d9-4176-a650-8b50730ec6ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.419048 Sep 08 01:19:00.284691 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 433/879] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:00.315906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:00.336077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:00.337249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:00.341666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-85ae1077-b53f-4e50-ba50-05267bb17940 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1608 microversion: 2.1 time: 0.211324 Sep 08 01:19:00.342338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 447/880] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:00 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1608 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:00.349252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:00.349753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:00.350194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.350901 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:00.351355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:00.351782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:00.527254 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:00.536233 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-15361e0e-8ff0-4c41-b47c-28235d628d00 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.204896 Sep 08 01:19:00.536824 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 434/881] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:00 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:00.996808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:01.071836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61087ac-46ab-4049-b1db-fed85fa93cf7", "tag": "aaddf7ea-b169-49c2-8975-6d2c99ba8401"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:01.083863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.084410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.084791 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.098945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] Creating event network-changed:aaddf7ea-b169-49c2-8975-6d2c99ba8401 for instance e61087ac-46ab-4049-b1db-fed85fa93cf7 on hv-cinder-84773 Sep 08 01:19:01.104083 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a5aa687d-da14-4672-8317-d3f76da6dfde req-93fc6291-f0ef-4d08-8665-a335159d9f84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112567 Sep 08 01:19:01.104916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 448/882] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:01.146719 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:01.147568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:01.155103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.155610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.156178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.157068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.157507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.157930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.190695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.191175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.191609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.192053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3e6b6b63-526f-482b-90ec-27c0b4d858a7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:01.237526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:01.246558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6060e276-be44-4eea-8b53-e6fb7d8d8e27 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1334 microversion: 2.1 time: 0.104086 Sep 08 01:19:01.247348 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 435/883] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:01 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:01.367530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:01.368268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:01.374532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.375024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.375490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.376214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.376674 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.377102 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.442395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:01.450941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ddb24505-be10-4be6-86eb-773c52318380 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1608 microversion: 2.1 time: 0.087712 Sep 08 01:19:01.451509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 449/884] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:01 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:01.559336 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:01.559870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:01.565782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.566268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.566756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.567446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:01.567894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:01.568362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:01.696296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:01.704413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-38d5cf9a-3a85-4406-825a-b8c13466c0fa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.149414 Sep 08 01:19:01.704972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 436/885] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:01 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:02.269698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:02.270234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:02.277646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.278126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.278553 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.279238 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.279687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.280104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.298805 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57bfe335-f009-4567-b8b1-b1f1fb648d59", "name": "network-vif-deleted", "tag": "2b614f05-722c-4dc3-a2a4-9c0f19d70a6f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:02.309311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.309823 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.310250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.312706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.313182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.313615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.314053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3e6b6b63-526f-482b-90ec-27c0b4d858a7 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:02.321485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] Creating event network-vif-deleted:2b614f05-722c-4dc3-a2a4-9c0f19d70a6f for instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 on hv-cinder-84773 Sep 08 01:19:02.326660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-4f16ab18-048b-4756-ac78-2778ddffb7fa req-eda872cd-88fa-4056-a6c4-9bde27e874c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031473 Sep 08 01:19:02.327239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 437/886] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:02.355096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:02.363472 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4c76da12-bdcf-4ee6-b0f7-23db3f6d034d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1334 microversion: 2.1 time: 0.097770 Sep 08 01:19:02.364041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 450/887] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:02 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:02.475476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:02.476204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:02.482894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.483370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.483803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.484527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.484981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.485427 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.547742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:02.555466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-59f95160-e065-477a-865f-8d7278548734 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1608 microversion: 2.1 time: 0.084220 Sep 08 01:19:02.556030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 438/888] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:02 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:02.727850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:02.728519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:02.735025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.735495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.735922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.736632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:02.737097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:02.737498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:02.866996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:02.874822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-118ca55e-b3cd-4c8f-9ed3-6a07c51df0d9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.150864 Sep 08 01:19:02.875395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 451/889] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:02 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:03.387576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:03.388232 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:03.395350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.395834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.396413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.397111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.397559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.397980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.430449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.430932 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.431372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.431828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3e6b6b63-526f-482b-90ec-27c0b4d858a7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:03.465557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:03.477335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:03.485590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b2c0418f-d3f2-4962-adac-b7cdfa08f17b tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 200 len: 1334 microversion: 2.1 time: 0.102875 Sep 08 01:19:03.486194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 439/890] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:03 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 1334 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:03.579425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:03.580078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:03.586986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.587504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.589240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.590170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.591068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.591544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.643799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.644239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.644673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.645293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lazy-loading 'fault' on Instance uuid 57bfe335-f009-4567-b8b1-b1f1fb648d59 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:03.695231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:03.703249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-51502a84-fe69-49d7-a5c2-26e858850978 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 200 len: 1328 microversion: 2.1 time: 0.127862 Sep 08 01:19:03.704337 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 452/891] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:03 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 1328 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:03.898699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:03.899394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:03.905170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=8 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:03.905725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:03.907499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.907986 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.908452 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:03.909180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:03.909653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:03.910364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:04.055460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:04.063685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-670af361-bbf4-43be-a63b-a8ed07344cd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.168811 Sep 08 01:19:04.064381 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 440/892] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:03 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:04.509460 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:04.510074 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3e6b6b63-526f-482b-90ec-27c0b4d858a7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:04.517087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:04.517602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:04.518065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:04.518837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:04.519292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:04.519716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:04.533848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] HTTP exception thrown: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Request method failure captured: Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 HTTP/1.1 Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG__Wf4mSFJF-q4KkfIdpEprqCkTrzo5YXOLw946PqSzz9gHlrtgc3sV9ROQvEfB4vnWlCUbaAgcgvYaYubxac0jZibBE-19dVA3xbcGAP4PYPktKnAcvi1061czlEWieZwaM-YisPxSPZVr9nz5CMMu5If6EToYYRq2o3nQ-USdIo Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:19:04.535613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f520f61ec5304a72ac707318d3a73b4f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f520f61ec5304a72ac707318d3a73b4f"}]}] Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 20af4425b7434d2dab7baeacbb845387 Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. Sep 08 01:19:04.537251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '3e6b6b63-526f-482b-90ec-27c0b4d858a7'} Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:19:04.538086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. Sep 08 01:19:04.539292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.540423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Returning 404 to user: Instance 3e6b6b63-526f-482b-90ec-27c0b4d858a7 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:19:04.540423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68388a32-c745-4266-a2b7-38532d2d78ca tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7" status: 404 len: 111 microversion: 2.1 time: 0.031748 Sep 08 01:19:04.540423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 453/893] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:04 2022] GET /compute/v2.1/servers/3e6b6b63-526f-482b-90ec-27c0b4d858a7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:19:04.545816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c71063d4-dab0-4ed9-95f0-50e3507a3d97 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '.version_select at 0x7fe9c9c30af0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:04.564614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c71063d4-dab0-4ed9-95f0-50e3507a3d97 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66559868" status: 202 len: 0 microversion: 2.1 time: 0.022537 Sep 08 01:19:04.565159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 441/894] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Sep 8 01:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66559868 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:19:04.730442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:04.732967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:04.739736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:04.740236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:04.740665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:04.741458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:04.741908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:04.742326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:04.756965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 HTTP/1.1 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:19:04.759709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:19:04.762457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '57bfe335-f009-4567-b8b1-b1f1fb648d59'} Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:19:04.763303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:19:04.764546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:04.765741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:19:04.765741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98bf2ff4-1cbe-4888-aba6-4b1130943dde tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 404 len: 111 microversion: 2.1 time: 0.034518 Sep 08 01:19:04.765741 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 454/895] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:04 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:19:04.771230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0ddb1271-980c-4053-b178-014f566d4ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '.version_select at 0x7fe9c9b19d30>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:04.790826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0ddb1271-980c-4053-b178-014f566d4ded tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137562005" status: 202 len: 0 microversion: 2.1 time: 0.023463 Sep 08 01:19:04.791401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 442/896] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 8 01:19:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137562005 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:19:05.087025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:05.087646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:05.094132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:05.094864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:05.095306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:05.096066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:05.096515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:05.096940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:05.291210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:05.316715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-98cd0f27-25ef-48c5-b86a-3498f3189483 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.233476 Sep 08 01:19:05.318326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 455/897] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:05 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:05.565108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8a3339b5-cff2-449d-ad2d-875e8cecaa75 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: .version_select at 0x7fe9c9da30d0>, body: {"keypair": {"name": "tempest-keypair-1140455310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsMQFDH6fqbVxnlznzn/xx5gssk9cNXal+HnNOw8fOhES3rHEAESBPhFBFa5kjhUVvtb9agt8MqJPEBTnOk2ey9SE09dgy8P0rfwHr/iY9bRb3XAhdiunDGxc+3ahf8ug=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:05.581152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-8a3339b5-cff2-449d-ad2d-875e8cecaa75 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for project 8c24dd087c274b6094aa720d81b11e98. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:19:05.585108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-8a3339b5-cff2-449d-ad2d-875e8cecaa75 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for user 3246a8dea80d4d5b8c3fb50d5f1f31c0 and project 8c24dd087c274b6094aa720d81b11e98. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:19:05.607627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8a3339b5-cff2-449d-ad2d-875e8cecaa75 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047230 Sep 08 01:19:05.608270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 443/898] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:19:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:06.342261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:06.342948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:06.349981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:06.350750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:06.351223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:06.352044 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:06.352585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:06.353080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:06.370504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:06.537738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:06.547212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4c0b2ef6-7f70-4df4-a31f-5204e1cc29bc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.209200 Sep 08 01:19:06.547687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 456/899] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:06 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:06.954660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2057399598", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5450ee5d-6e77-4a01-a611-6d543e3afa6d"}], "security_groups": [{"name": "tempest-securitygroup--532180793"}], "key_name": "tempest-keypair-1140455310", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:07.056670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] validate_networks() for [('5450ee5d-6e77-4a01-a611-6d543e3afa6d', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:19:07.418428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:19:07.418856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:19:07.419331 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:19:07.419744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:19:07.420181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:19:07.428859 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.429341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.429798 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.430526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.430986 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.431411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.449744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for project 8c24dd087c274b6094aa720d81b11e98. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:19:07.454082 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Getting quotas for user 3246a8dea80d4d5b8c3fb50d5f1f31c0 and project 8c24dd087c274b6094aa720d81b11e98. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:19:07.465851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:19:07.468181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:19:07.515958 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fc4bb73a-036c-4d60-8415-5588ae895cb5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565812 Sep 08 01:19:07.516516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 444/900] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:19:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:19:07.524515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:07.525041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:07.527988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3b54225c-f701-4417-99c5-b64143164bd4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:07.528627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3b54225c-f701-4417-99c5-b64143164bd4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:07.532541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.533034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.534110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.534833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.535288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.535711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.595674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3b54225c-f701-4417-99c5-b64143164bd4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:07.603860 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3b54225c-f701-4417-99c5-b64143164bd4 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1238 microversion: 2.1 time: 0.080233 Sep 08 01:19:07.604729 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 445/901] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:07 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:07.614669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:07.615466 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:07.622461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.622949 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.623386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.624092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.624579 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.625005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.725071 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:19:07.836385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:07.836385 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-443348fa-f4fc-4465-acb1-f9a39b501b71 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.228429 Sep 08 01:19:07.839896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f23ab8a1-b526-4f22-b88f-bdba1969be76 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 204 len: 0 microversion: 2.1 time: 0.317028 Sep 08 01:19:07.840712 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 446/902] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:07 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:07.844057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 457/903] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:19:07 2022] DELETE /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:19:07.849854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:07.850335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:07.856636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.857115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.857892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.858593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:07.859190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:07.859463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:07.995946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:08.004153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ccd88625-f07e-4cc4-a360-56e3b8750193 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1508 microversion: 2.1 time: 0.158646 Sep 08 01:19:08.004825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 447/904] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:07 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:08.628724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:08.629457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:08.636230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:08.637279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:08.637717 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:08.638406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:08.638857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:08.639278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:08.701195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:08.708967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-855f88ef-1c4a-42a1-9c42-2fce51df31c6 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1242 microversion: 2.1 time: 0.084471 Sep 08 01:19:08.709529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 458/905] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:08 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:08.859219 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:08.859989 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:08.868675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:08.869156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:08.869587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:08.870275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:08.871424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:08.872120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:09.019334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:09.027280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c14b7f47-3384-4503-be6f-7971914af74c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.172412 Sep 08 01:19:09.028213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:09.028464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 448/906] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:08 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:09.029216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:09.034943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:09.035420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:09.035849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:09.036558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:09.037008 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:09.037429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:09.172326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:09.180814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-84ba6514-3740-4612-b6bc-dfd8edaa6e3a tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1508 microversion: 2.1 time: 0.156683 Sep 08 01:19:09.181416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 459/907] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:09 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:09.732416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:09.732951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:09.739505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:09.739985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:09.740446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:09.741168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:09.741618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:09.742036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:09.804026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:09.812168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1a5524fc-f738-45d4-b77e-637e5c702ccd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1234 microversion: 2.1 time: 0.084737 Sep 08 01:19:09.812736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 449/908] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:09 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:10.051278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:10.053392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:10.060614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.061101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.061749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.062980 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.064223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.065340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.206707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:10.207344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:10.215535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.216916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.218044 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.218977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.219448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.219884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.330116 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:10.343206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-539cda9f-0f6b-4742-b746-6143f84806e9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.296573 Sep 08 01:19:10.344504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 460/909] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:10 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:10.358136 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:10.366194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d30b67a1-f83f-4cfd-98d0-360d517e37cc tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1508 microversion: 2.1 time: 0.164371 Sep 08 01:19:10.366763 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 450/910] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:10 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:10.641808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a982f8af-808c-4b79-bf51-ac72f1c60699", "name": "network-vif-deleted", "tag": "5a30e87b-823e-4d82-a9ce-a31b03decd58"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:10.651563 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.652897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.653458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.665096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] Creating event network-vif-deleted:5a30e87b-823e-4d82-a9ce-a31b03decd58 for instance a982f8af-808c-4b79-bf51-ac72f1c60699 on hv-cinder-84773 Sep 08 01:19:10.670769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-135a9b9a-283b-47e0-b7f4-94e6171444df req-9c671ed7-2758-4a67-a7c5-731716c0b0aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032523 Sep 08 01:19:10.671364 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 461/911] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:10.836528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:10.837584 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:10.844680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.845367 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.845882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.846715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:10.847175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:10.847628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:10.918327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:10.921732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:10.932756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-93ca0084-a2ff-4e49-a57d-af5043143afe tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1296 microversion: 2.1 time: 0.099802 Sep 08 01:19:10.947501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 451/912] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:10 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:11.370255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:11.371526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:11.379048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.379961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.380796 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.381676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.382528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.382957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.508192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61087ac-46ab-4049-b1db-fed85fa93cf7", "name": "network-vif-plugged", "status": "completed", "tag": "aaddf7ea-b169-49c2-8975-6d2c99ba8401"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:11.518900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.519529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.520078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.532429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] Creating event network-vif-plugged:aaddf7ea-b169-49c2-8975-6d2c99ba8401 for instance e61087ac-46ab-4049-b1db-fed85fa93cf7 on hv-cinder-84773 Sep 08 01:19:11.538273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-d2fd7127-b2f1-4c17-a5b1-f2aee5a226ae req-f222bc3f-fc9c-482f-a25d-4bece039e309 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182499 Sep 08 01:19:11.539040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 462/913] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:11.545490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:11.546334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:11.552933 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.553566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.554101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.554910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.555459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.555983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.607391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.608387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.609122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.609914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid a982f8af-808c-4b79-bf51-ac72f1c60699 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:11.711858 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:11.761287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e150a495-2e30-43ef-84b8-a7bd80881d4d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 200 len: 1312 microversion: 2.1 time: 0.217586 Sep 08 01:19:11.764294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 463/914] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:11 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:11.918975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:11.927919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a1f76f84-ff76-4ac0-a0f9-81b4ca22093c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.562840 Sep 08 01:19:11.928772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 452/915] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:11 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:11.958275 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:11.959007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:11.965630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.966111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.966790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:11.967494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:11.967947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:11.968414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.195095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:12.204323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-52dee967-567e-4503-9ab8-47146c34e38f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.250247 Sep 08 01:19:12.205252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 464/916] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:11 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:12.687243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f46ee2-3552-464f-81dc-f5981ed0b275", "tag": "9a7efca8-1d75-42a6-9419-1367ce0930d1"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:12.699880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.700582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.701540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.712938 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] Creating event network-changed:9a7efca8-1d75-42a6-9419-1367ce0930d1 for instance 24f46ee2-3552-464f-81dc-f5981ed0b275 on hv-cinder-84773 Sep 08 01:19:12.718108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-1cf16829-401e-4449-ac36-d520a9e6ccd8 req-3e7a150d-20dd-40ae-9dee-2895ba84a799 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035221 Sep 08 01:19:12.718682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 453/917] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:12.788252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:12.788872 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: a982f8af-808c-4b79-bf51-ac72f1c60699] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:12.796233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.796719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.797159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.797856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.798314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.798745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.813316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] HTTP exception thrown: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Request method failure captured: Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 HTTP/1.1 Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG__Wf4mSFJF-q4KkfIdpEprqCkTrzo5YXOLw946PqSzz9gHlrtgc3sV9ROQvEfB4vnWlCUbaAgcgvYaYubxac0jZibBE-19dVA3xbcGAP4PYPktKnAcvi1061czlEWieZwaM-YisPxSPZVr9nz5CMMu5If6EToYYRq2o3nQ-USdIo Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:19:12.815016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f520f61ec5304a72ac707318d3a73b4f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f520f61ec5304a72ac707318d3a73b4f"}]}] Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 20af4425b7434d2dab7baeacbb845387 Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. Sep 08 01:19:12.816673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'a982f8af-808c-4b79-bf51-ac72f1c60699'} Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:19:12.817665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. Sep 08 01:19:12.819154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:19:12.820843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Returning 404 to user: Instance a982f8af-808c-4b79-bf51-ac72f1c60699 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:19:12.820843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7e11bb07-27c4-4995-8788-8f781028534c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699" status: 404 len: 111 microversion: 2.1 time: 0.032063 Sep 08 01:19:12.820843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 465/918] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:12 2022] GET /compute/v2.1/servers/a982f8af-808c-4b79-bf51-ac72f1c60699 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:19:12.826367 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:12.826953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:12.833150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.833636 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.834077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.834761 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.835226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.835650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.865912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:19:12.952002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:12.953173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:12.958618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-72a6a1c1-7593-478e-b7b1-b1f6f4fa29d7 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 204 len: 0 microversion: 2.1 time: 0.136811 Sep 08 01:19:12.959383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 454/919] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:19:12 2022] DELETE /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 01:19:12.965571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.966080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.966522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.967522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.968218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.968889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.970250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:12.971052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:12.979461 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.980099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.980627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:12.981399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:12.982559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:12.983150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:13.110790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:13.119058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-509a1e84-b4ee-4619-96a9-2bfbe0483369 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1365 microversion: 2.1 time: 0.171595 Sep 08 01:19:13.119946 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 466/920] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:12 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:13.130913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:13.139863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c936b16a-34bc-499e-8614-09afcd6b1b94 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.175588 Sep 08 01:19:13.140474 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 455/921] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:12 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:13.228235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:13.228818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:13.234959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:13.235443 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:13.235880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:13.236604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:13.237067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:13.237498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:13.367575 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:13.375729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7b33f761-4069-412c-a426-eb42b24eb11b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.151429 Sep 08 01:19:13.376338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 467/922] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:13 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:14.143561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:14.144451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:14.150801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.151318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.151800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.153090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.153541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.153964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.166350 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:14.167453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:14.174450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.175580 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.176319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.177535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.178271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.179192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.329601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:14.331376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:14.337732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8a829470-f285-489c-abe4-f4e75504b5d4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1554 microversion: 2.1 time: 0.198057 Sep 08 01:19:14.338616 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 456/923] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:14 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:14.353491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3653201b-3b0f-493f-a255-f3a3b7d3aa9c tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.191635 Sep 08 01:19:14.354166 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 468/924] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:14 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:14.362776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:14.363356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:14.369711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.370228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.371272 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.372050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.372623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.373049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.399560 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:14.400822 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:14.408643 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.409215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.409657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.410866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:14.411484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:14.411908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:14.466809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3f4ab36b-a9cf-4fb3-85fb-df5164a7522e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107520 Sep 08 01:19:14.467431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 457/925] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:19:14 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:19:14.609347 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:14.617346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d92bd46d-c578-496c-8514-febc21dc721d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.222413 Sep 08 01:19:14.618604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 469/926] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:14 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:15.378043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:15.379604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:15.386268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:15.386683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:15.387345 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:15.388299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:15.388856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:15.389722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:15.509354 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e61087ac-46ab-4049-b1db-fed85fa93cf7", "tag": "aaddf7ea-b169-49c2-8975-6d2c99ba8401"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:15.521616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:15.522093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:15.522707 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:15.541108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] Creating event network-changed:aaddf7ea-b169-49c2-8975-6d2c99ba8401 for instance e61087ac-46ab-4049-b1db-fed85fa93cf7 on hv-cinder-84773 Sep 08 01:19:15.547044 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-b7214bab-41bd-4ef1-a8b6-38cde7cf8193 req-06a00b0b-64ab-4966-90bc-9c7d81d7c2c8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041980 Sep 08 01:19:15.548172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 470/927] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:19:15.582540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:15.591335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1ef8d731-1a6b-4929-9df8-073104ca8660 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.217686 Sep 08 01:19:15.591963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 458/928] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:15 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:15.642604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:15.643379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:15.649501 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:15.649976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:15.650591 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:15.651469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:15.652176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:15.652859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:15.811107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:15.821537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0001cca7-bb20-4694-89f8-488b665f4f95 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.182803 Sep 08 01:19:15.822458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 471/929] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:15 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:16.615807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:16.616568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:16.623523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:16.624312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:16.624826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:16.625535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:16.625992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:16.626420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:16.823251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:16.831519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aec40e98-b719-4cda-bcd3-f77c424f226d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1521 microversion: 2.1 time: 0.219595 Sep 08 01:19:16.832306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 459/930] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:16 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:16.844705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:16.845313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:16.851710 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:16.852216 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:16.852658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:16.853346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:16.853894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:16.854319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:17.013088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:17.021303 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-acd68a21-e9d4-4868-b59d-eadcba658498 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.180744 Sep 08 01:19:17.021959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 472/931] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:16 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:17.562935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d582038-e2ec-4bbc-ad3e-2300a1351fee", "name": "network-vif-deleted", "tag": "b6117acd-350d-4456-834b-c9a47241d546"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:17.567841 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:17.574576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:17.575133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:17.575564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:17.586151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] Creating event network-vif-deleted:b6117acd-350d-4456-834b-c9a47241d546 for instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee on hv-cinder-84773 Sep 08 01:19:17.591095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-4444a9f6-1142-4023-a0d6-86e475a691cf req-4401c7bf-c6fd-44bd-a798-aeaab5ebb5fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031933 Sep 08 01:19:17.591668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 460/932] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:17.855660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:17.856194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:17.862728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:17.863209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:17.863639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:17.864352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:17.864803 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:17.865225 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:17.926967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:17.929249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:17.936894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-88502744-2d2b-4010-be2a-836c2b942ebe tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1479 microversion: 2.1 time: 0.085605 Sep 08 01:19:17.937373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 473/933] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:17 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:18.047488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:18.048215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:18.050302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=12 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:18.055983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:18.056502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:18.056942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:18.057658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:18.058832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:18.059268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:18.190970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:18.198586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f1a00a53-bff4-4fc7-bfb4-bd348ae576c7 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.155290 Sep 08 01:19:18.199159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 461/934] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:18 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:18.961328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:18.961927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:18.969919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:18.970399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:18.970831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:18.971521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:18.971962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:18.972406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:19.038835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:19.046958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4b28866b-54fe-46a8-bd4d-4a3d565f6756 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1479 microversion: 2.1 time: 0.090328 Sep 08 01:19:19.047512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 474/935] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:18 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1479 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:19.220551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:19.221090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:19.227556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:19.228015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:19.228498 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:19.229180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:19.229635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:19.230065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:19.357723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:19.365263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b205f810-16b5-4e07-ab8e-50c0af676e0b tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.148637 Sep 08 01:19:19.365853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 462/936] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:19 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:20.070894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:20.071509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:20.078559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:20.079042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:20.079484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:20.080204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:20.080664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:20.081098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:20.156614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:20.165133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b42a7ece-4c03-49fe-8df2-695b0cfcee68 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1479 microversion: 2.1 time: 0.098062 Sep 08 01:19:20.165709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 475/937] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:20 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1479 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:20.389159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:20.389963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:20.396372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:20.397484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:20.398128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:20.398829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:20.399280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:20.399757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:20.641748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:20.649537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-43a3d049-1548-43ef-9764-4ed63715aba9 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.264567 Sep 08 01:19:20.650095 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 463/938] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:20 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:21.189358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:21.189918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:21.196418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.196898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.197334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.198022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.198478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.199506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.229852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.230529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.230969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.231446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3d582038-e2ec-4bbc-ad3e-2300a1351fee {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:21.273037 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:21.281122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cefa58c7-2bfa-4487-8a67-50659fcdf828 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1312 microversion: 2.1 time: 0.095742 Sep 08 01:19:21.281682 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 476/939] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:21 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:21.346330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:21.346811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:21.352701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.353172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.353602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.354279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.354720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.355138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.378329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3e78306c-3295-46e0-8eaf-b93eacbb4395 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/ips" status: 200 len: 152 microversion: 2.20 time: 0.035881 Sep 08 01:19:21.378884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 464/940] 10.222.0.42 () {60 vars in 1289 bytes} [Thu Sep 8 01:19:21 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:19:21.674539 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:21.675860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:21.685613 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.686165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.686607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.687339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:21.687781 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:21.688235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:21.816988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:21.825292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1149265b-adcc-4b13-9f1e-5047eab1e4aa tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.155350 Sep 08 01:19:21.825876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 477/941] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:21 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:19:22.304582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:22.305190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:22.311832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:22.312350 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:22.312782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:22.313476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:22.313931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:22.314360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:22.345494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:22.345963 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:22.346395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:22.346834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3d582038-e2ec-4bbc-ad3e-2300a1351fee {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:22.390505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:22.398212 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-16ae4300-65da-4feb-849d-b5e69403de64 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1312 microversion: 2.1 time: 0.097472 Sep 08 01:19:22.398781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 465/942] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:22 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:22.848126 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:22.848711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:22.855852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:22.856377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:22.856818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:22.857516 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:22.857978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:22.858411 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:22.991900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:22.999653 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9250fc73-cf5f-4230-9a35-7d396683254f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.155498 Sep 08 01:19:23.000234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 478/943] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:22 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:23.422128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:23.422743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:23.429351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:23.429842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:23.430277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:23.430993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:23.431449 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:23.431880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:23.467298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:23.467827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:23.468326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:23.469055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lazy-loading 'fault' on Instance uuid 3d582038-e2ec-4bbc-ad3e-2300a1351fee {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:23.737622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20af4425b7434d2dab7baeacbb845387', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f520f61ec5304a72ac707318d3a73b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:23.755842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f619237a-d4c9-4be3-8079-46c1cb7fee10 tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 200 len: 1312 microversion: 2.1 time: 0.337554 Sep 08 01:19:23.756699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 466/944] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:23 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 1312 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:24.022496 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:24.023112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:24.030162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.030654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.031093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.031786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.032266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.032695 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.160437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:24.169156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a1717261-06a6-4f9f-a43e-361b17db7a59 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.150476 Sep 08 01:19:24.169974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 479/945] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:24 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:24.496937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:24.497464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:24.503791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.504303 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.504737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.505416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.505863 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.506280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.529686 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'flavor' on Instance uuid 267b508d-389c-4e8b-9812-6b4ec8264b68 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:19:24.549865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:24.740990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3298e0ec-8c61-4874-83da-5444da4a1f57 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/action" status: 202 len: 0 microversion: 2.20 time: 0.248002 Sep 08 01:19:24.744884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 467/946] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 8 01:19:24 2022] POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:19:24.750213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:24.752589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:24.763966 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.764509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.765393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.766276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.766754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.767175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.780886 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:24.781595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] [instance: 3d582038-e2ec-4bbc-ad3e-2300a1351fee] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:24.787885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.788411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.788854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.789552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:24.790015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:24.790440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:24.806472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] HTTP exception thrown: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Request method failure captured: Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee HTTP/1.1 Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG__Wf4mSFJF-q4KkfIdpEprqCkTrzo5YXOLw946PqSzz9gHlrtgc3sV9ROQvEfB4vnWlCUbaAgcgvYaYubxac0jZibBE-19dVA3xbcGAP4PYPktKnAcvi1061czlEWieZwaM-YisPxSPZVr9nz5CMMu5If6EToYYRq2o3nQ-USdIo Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:19:24.808337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f520f61ec5304a72ac707318d3a73b4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f520f61ec5304a72ac707318d3a73b4f", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f520f61ec5304a72ac707318d3a73b4f"}]}] Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: f520f61ec5304a72ac707318d3a73b4f Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1867218768 Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 20af4425b7434d2dab7baeacbb845387 Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1867218768-project Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. Sep 08 01:19:24.810053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '3d582038-e2ec-4bbc-ad3e-2300a1351fee'} Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:19:24.810812 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. Sep 08 01:19:24.812043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:19:24.814243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] Returning 404 to user: Instance 3d582038-e2ec-4bbc-ad3e-2300a1351fee could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:19:24.814243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b898632b-5888-4b35-98d7-dde33250014d tempest-ServerRescueNegativeTestJSON-1867218768 tempest-ServerRescueNegativeTestJSON-1867218768-project] 10.222.0.42 "GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee" status: 404 len: 111 microversion: 2.1 time: 0.033820 Sep 08 01:19:24.814243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 468/947] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:24 2022] GET /compute/v2.1/servers/3d582038-e2ec-4bbc-ad3e-2300a1351fee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:19:24.913817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:24.922200 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:24.923721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:24.924937 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-23389e88-5cba-4979-b78f-7390f11345c5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.178807 Sep 08 01:19:24.925493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 480/948] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:24 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:19:25.192366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:25.192979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:25.194905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:25.200978 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:25.201467 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:25.201906 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:25.202599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:25.203049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:25.203474 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:25.442820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:25.451509 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c9322216-afa1-4e75-9315-7b6e2742b985 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.262974 Sep 08 01:19:25.452333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 469/949] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:25 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:25.952312 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:25.958084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:25.966251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:25.966735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:25.967168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:25.967856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:25.968341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:25.968763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:26.103280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:26.111876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:26.113346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:26.114520 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6eb9bbf3-fff4-4eeb-9e6d-2968395f16d7 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.166487 Sep 08 01:19:26.115075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 481/950] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:25 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:26.474253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:26.474865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:26.484914 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:26.485506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:26.486034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:26.486941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:26.487649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:26.488208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:26.675643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:26.684861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fdda5ee7-afc9-4d4a-b5f6-66b012042955 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.214314 Sep 08 01:19:26.685756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 470/951] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:26 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:27.141467 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:27.142092 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:27.148859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:27.149355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:27.149800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:27.150511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:27.150970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:27.151400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:27.303088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:27.312289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:27.313859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:27.315145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-62b10952-1c4b-4188-87f8-488c7d3b9691 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.177880 Sep 08 01:19:27.315797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 482/952] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:27 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:27.710668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:27.711290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:27.726422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:27.727098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:27.727619 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:27.728533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:27.729077 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:27.729568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:27.989083 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:28.002009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5217f5e0-903f-440f-b364-335d5e6fef2f tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.298434 Sep 08 01:19:28.002765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 471/953] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:27 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:28.064166 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f46ee2-3552-464f-81dc-f5981ed0b275", "name": "network-vif-plugged", "status": "completed", "tag": "9a7efca8-1d75-42a6-9419-1367ce0930d1"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:28.076567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:28.077638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:28.078352 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:28.095918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] Creating event network-vif-plugged:9a7efca8-1d75-42a6-9419-1367ce0930d1 for instance 24f46ee2-3552-464f-81dc-f5981ed0b275 on hv-cinder-84773 Sep 08 01:19:28.101566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-0bc0134d-f5e8-4904-8dc1-660dc74c281c req-ada72683-b50d-40b6-a248-c3a962f5f738 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042239 Sep 08 01:19:28.102716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 483/954] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:28.341571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:28.342181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:28.351862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:28.352383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:28.352826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:28.355444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:28.356326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:28.356757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:28.630366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:28.640415 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:28.642043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:28.643222 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a29a2fd9-3eda-4b20-bf3b-92f0d883f0b3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.305817 Sep 08 01:19:28.643822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 472/955] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:28 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:29.028256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:29.029043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:29.035478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:29.036255 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:29.037124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:29.037888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:29.038409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:29.038900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:29.197678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:29.208658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7d8319ca-b489-48b0-ab44-890160fbd4e5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.186141 Sep 08 01:19:29.209220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 484/956] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:29 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:29.672514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:29.673136 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:29.680393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:29.680881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:29.681526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:29.682238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:29.683399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:29.684173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:29.873900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:29.883912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:29.885495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:29.887489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a8b7d5dc-2448-45dd-9087-3ad4ae727d1b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.221234 Sep 08 01:19:29.888200 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 473/957] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:29 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:30.233270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:30.233888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:30.236355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:30.241324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:30.241790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:30.242228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:30.242940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:30.243395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:30.243824 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:30.403105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:30.414360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c0ce5e23-8a14-44e0-9122-502582852fac tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1363 microversion: 2.1 time: 0.185292 Sep 08 01:19:30.419775 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 485/958] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:30 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:30.913079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:30.913695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:30.920551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:30.921030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:30.921464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:30.922155 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:30.922828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:30.923022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:31.113005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:31.122858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:31.124365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:31.125549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a7548b5d-4476-4466-9b8c-9f47d9141c9f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.216376 Sep 08 01:19:31.126145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 474/959] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:30 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:31.439555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:31.440185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:31.446551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:31.447033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:31.447478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:31.448188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:31.448696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:31.449245 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:31.657363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:31.665006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d921d9d5-4bc1-40f8-83c8-afd63da1d5d8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1550 microversion: 2.1 time: 0.229368 Sep 08 01:19:31.665664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 486/960] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:19:31 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1550 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:19:31.690535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:31.691296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:31.698226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:31.699060 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:31.699737 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:31.700777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:31.701739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:31.702221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:31.792868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-77ed1bbd-85cf-497d-be8b-ed1a11d8d42d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105608 Sep 08 01:19:31.793482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 475/961] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:19:31 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:32.153612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:32.154321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:32.160891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:32.161384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:32.161854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:32.162574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:32.163017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:32.163439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:32.617279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:32.627270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:32.629576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:32.631060 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d7e8f199-660b-4d8f-a601-16ee9921ae0f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.482834 Sep 08 01:19:32.643208 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 487/962] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:32 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:33.188521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f46ee2-3552-464f-81dc-f5981ed0b275", "tag": "9a7efca8-1d75-42a6-9419-1367ce0930d1"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:33.199745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:33.200538 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:33.201857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:33.214791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] Creating event network-changed:9a7efca8-1d75-42a6-9419-1367ce0930d1 for instance 24f46ee2-3552-464f-81dc-f5981ed0b275 on hv-cinder-84773 Sep 08 01:19:33.220294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-3b72e3cc-d75f-4ddb-be3c-5688840906f9 req-10cfcfcc-8ad1-4103-ac21-81aef78917d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035879 Sep 08 01:19:33.220999 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 476/963] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:33.658287 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:33.659758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:33.668011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:33.668732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:33.669517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:33.670904 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:33.671421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:33.672056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:33.855258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:33.866598 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:33.869619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:33.872358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b80b0c5f-b75a-4c1c-8aec-45bb15fc2f93 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.218501 Sep 08 01:19:33.873810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 488/964] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:33 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:34.901964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:34.902992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:34.910907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:34.911529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:34.912223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:34.913006 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:34.913730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:34.914324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:35.087725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:35.097821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:35.099357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:35.101296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9e16cf29-071a-4689-87f0-feca7cb66e44 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.203576 Sep 08 01:19:35.101873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 477/965] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:34 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:36.134400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:36.135155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:36.144251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:36.144854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:36.145527 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:36.146453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:36.147593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:36.148304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:36.404326 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:36.421595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:36.423025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:36.424227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-32b73ee7-7b7d-499b-8385-e802032d3cd0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1745 microversion: 2.20 time: 0.299252 Sep 08 01:19:36.424788 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 489/966] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:36 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1745 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:37.451297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:37.452576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:37.461251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:37.462339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:37.463409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:37.468777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:37.469608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:37.470234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:37.742872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:37.759905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:37.761781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:37.762992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-38705823-1a35-4c17-8142-0693dd166ca8 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1745 microversion: 2.20 time: 0.317055 Sep 08 01:19:37.776777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 478/967] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:37 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1745 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:38.793143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:38.793779 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:38.804927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:38.806250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:38.807406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:38.809968 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:38.810254 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:38.813406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:38.978026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:38.981296 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:38.993149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:38.996174 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:38.997616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-68caf200-4ff8-48ba-bc2a-f2edbb42546d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.210781 Sep 08 01:19:38.998708 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 490/968] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:38 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:40.033091 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:40.036422 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:40.053592 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:40.056501 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:40.058194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:40.061567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:40.066948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:40.067601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:40.453623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:40.469308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:40.471842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:40.478643 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8af716f5-5a6c-4663-9639-058083ac9116 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.452570 Sep 08 01:19:40.480748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 479/969] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:40 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:40.523304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "name": "network-vif-plugged", "status": "completed", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:40.555284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:40.561339 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:40.562203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:40.591275 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] Creating event network-vif-plugged:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:19:40.599434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-cd22f606-023b-4cef-aafb-1251726bcbc6 req-b67e4b68-009a-4058-9b2c-b5e78ca3cd25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080617 Sep 08 01:19:40.606954 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 491/970] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:19:41.507533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:41.508246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:41.528551 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:41.529868 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:41.530388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:41.531140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:41.531604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:41.532038 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:42.180534 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:42.230166 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:42.236865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:42.238811 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-395b0406-0c73-4804-aadd-1f0729d6f254 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.735810 Sep 08 01:19:42.242458 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 480/971] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:41 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:43.267462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:43.268489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:43.307800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:43.312165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:43.312652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:43.317566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:43.318084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:43.318543 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:43.643031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:43.673162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:43.675261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:43.688687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e7868861-8108-49db-a920-e494c0ad5b0e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.426101 Sep 08 01:19:43.696441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 492/972] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:43 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:19:44.730521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:44.731349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:44.742220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:44.742715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:44.743155 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:44.743876 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:44.744365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:44.751747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:45.054440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:45.068670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:45.071884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:45.073961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0b7b97b3-b365-4c3c-9d52-8a15ce0fb312 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.351139 Sep 08 01:19:45.093577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 481/973] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:44 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:46.113027 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:46.113646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:46.125623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:46.128951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:46.129663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:46.131648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:46.133269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:46.134313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:46.371783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:46.389052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:46.391742 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:46.393617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b4b4a7e8-30b1-4f53-bce6-e94720760d70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.287438 Sep 08 01:19:46.394478 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 493/974] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:46 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:19:47.424657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:47.426005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:47.438373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:47.441913 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:47.444306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:47.445482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:47.446638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:47.450027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:47.713706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:47.729955 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:47.733338 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:47.734977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eac3e839-77f0-4238-b555-5b312a9a715f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.314376 Sep 08 01:19:47.749145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 482/975] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:47 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:48.783579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:48.787702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:48.802270 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:48.802776 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:48.803229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:48.803950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:48.808894 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:48.809349 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:49.363149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:49.381884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:49.383794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:49.385049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a2604e0a-0c47-400f-a05c-c4b77faec09f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.611900 Sep 08 01:19:49.386164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 494/976] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:48 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:50.389965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7d263d81-5b4d-4ec3-9ebe-17151cec6edd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Action: 'create', calling method: .version_select at 0x7fe9c9ee7a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1893073206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXtkCnTYwykYC2TI7Pw4WqEBBVBXKGGngBJUXL+UtM/YwKStr6KSxQvC5WmlideGWdRqfAZOqnFpNs9p/msCHXGFomVWK6crQVks+jVIxz+2owBXrXcWPdhQqGHox2xdQ=="}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:50.409489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-7d263d81-5b4d-4ec3-9ebe-17151cec6edd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Getting quotas for project e32dd1d6dcf54fbb83667953c4cbea29. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:19:50.413369 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:50.413842 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:50.426889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:50.427802 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:50.431441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:50.434077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:50.434719 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:50.436602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:50.443968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-7d263d81-5b4d-4ec3-9ebe-17151cec6edd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Getting quotas for user 00917dba4a9f4d56be3ec74f90a65154 and project e32dd1d6dcf54fbb83667953c4cbea29. Resources: {'key_pairs'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:19:50.503009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7d263d81-5b4d-4ec3-9ebe-17151cec6edd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.405905 Sep 08 01:19:50.504228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 483/977] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:19:50 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:50.748879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:50.770331 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:50.771859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:50.773123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-abaf971f-5723-4dc1-8ded-3cdf7be7ae76 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.364193 Sep 08 01:19:50.773680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 495/978] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:50 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:51.805080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:51.806117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:51.824529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:51.826397 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:51.827182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:51.828481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:51.829146 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:51.829787 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:52.146780 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:52.172356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:52.201499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:52.203142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-94140777-18bf-4209-90e7-b1a36901d65e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.402594 Sep 08 01:19:52.204049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 484/979] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:51 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:53.233727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:53.234358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:53.241363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:53.242175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:53.242813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:53.243690 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:53.244332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:53.245511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:53.406172 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:53.427747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:53.430446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:53.432616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-31360ba6-7872-411c-a4a4-1a4393ca26c4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.203696 Sep 08 01:19:53.433799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 496/980] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:53 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:54.463130 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:54.464193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:54.471957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:54.472699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:54.473098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:54.474173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:54.474556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:54.475332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:54.525567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:54.677750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:54.692933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:54.697398 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:54.698936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1749df52-7d8c-4a6a-912b-c12dc9de2c46 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.239749 Sep 08 01:19:54.699781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 485/981] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:54 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:55.729365 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:55.730669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:55.740732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:55.741436 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:55.742073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:55.742988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:55.743599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:55.744206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:56.015212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:56.024272 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:56.025919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:56.027170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-17b1e9ad-7686-4ee1-9483-18060ce97de9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1740 microversion: 2.20 time: 0.304374 Sep 08 01:19:56.027723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 497/982] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:55 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1740 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:57.058753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:57.059341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:57.062770 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:19:57.067557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:57.068043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:57.068526 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:57.069378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:57.069825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:57.070247 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:57.295196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:57.305048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:57.307537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:57.309265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2710a099-fd5b-43d2-acc8-7e489e264297 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1722 microversion: 2.20 time: 0.254774 Sep 08 01:19:57.320768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 486/983] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:57 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:58.336406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:58.337039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:58.344532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:58.345163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:58.345685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:58.346384 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:58.346832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:58.347255 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:58.494812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:58.503833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:58.505297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:58.506466 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b29b9ce4-1a72-4042-90e5-5dc661d42da5 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1722 microversion: 2.20 time: 0.174128 Sep 08 01:19:58.507028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 498/984] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:58 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:59.144445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:59.145022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:59.151933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.152451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.152895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:59.153585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.154041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.154470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:59.177561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9887c68-578d-4103-b977-87cc25c02b6f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/ips" status: 200 len: 149 microversion: 2.1 time: 0.036916 Sep 08 01:19:59.184239 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 487/985] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:19:59 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:19:59.532979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:19:59.533589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:59.549328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.549996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.550507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:59.551252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.551688 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.552113 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:59.687701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:59.695752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:59.697231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:19:59.698418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6777c2b2-bff0-4a17-9be3-d6a249a4c54c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1725 microversion: 2.20 time: 0.169820 Sep 08 01:19:59.698981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 499/986] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:19:59 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:19:59.723519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f9aad1c-8209-4610-9788-cdfa7f0bd7bf"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:19:59.725993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:19:59.732708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.733183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.733647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:19:59.734321 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:19:59.734764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:19:59.735183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.001546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "name": "network-vif-unplugged", "status": "completed", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:00.014590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.016683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.017224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.036785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] Creating event network-vif-unplugged:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:20:00.043131 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-ef41e2f9-1fd4-427e-b7bf-66aa75c1eb78 req-fbbacb9a-d4e0-4147-8d45-c9cd3662ed1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045021 Sep 08 01:20:00.044113 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 500/987] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:20:00.078190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8de092c7-10c8-4aee-836a-6563cb72ca64 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.358685 Sep 08 01:20:00.078967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 488/988] 10.222.0.42 () {62 vars in 1364 bytes} [Thu Sep 8 01:19:59 2022] POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments => generated 188 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 01:20:00.210590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:00.211106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:00.217989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.218482 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.218917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.219626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.220082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.220537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.481778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-13ef2698-734d-4fe4-b0d4-475cb4e52264 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments/3f9aad1c-8209-4610-9788-cdfa7f0bd7bf" status: 202 len: 0 microversion: 2.20 time: 0.275611 Sep 08 01:20:00.482378 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 501/989] 10.222.0.42 () {60 vars in 1457 bytes} [Thu Sep 8 01:20:00 2022] DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments/3f9aad1c-8209-4610-9788-cdfa7f0bd7bf => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:20:00.542264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de71e1a2-9046-453f-8852-32bcfc657758"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:00.545125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:00.545646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:00.545770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:00.548167 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=34 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:00.548982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=4 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:00.554792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.555278 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.555889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.556310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.556800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.556991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.557247 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.557708 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.558329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.558677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.559208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.559706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.590603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120715) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 01:20:00.665414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-114649c5-905d-4e3d-90e2-049928cac5a2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/action" status: 202 len: 0 microversion: 2.20 time: 0.124911 Sep 08 01:20:00.668427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 502/990] 10.222.0.42 () {62 vars in 1319 bytes} [Thu Sep 8 01:20:00 2022] POST /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 01:20:00.674861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:00.675067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:00.681290 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.681726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.682675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.683387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:00.683848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:00.684300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:00.829519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:00.838223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:00.839670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:00.840871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1228355-138b-45b5-afca-f3b7f4ae8bc1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.170157 Sep 08 01:20:00.841427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 503/991] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:00 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:00.865547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7ef00287-2ea3-470e-b10c-c4000e815348 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328413 Sep 08 01:20:00.866216 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 489/992] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:20:00 2022] POST /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:01.868220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:01.868801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:01.875827 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:01.876357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:01.876798 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:01.877489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:01.877943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:01.878373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:02.026307 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:02.034997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:02.036468 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:02.037635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-438df645-00f2-4ba6-90c6-659223c1b572 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.173509 Sep 08 01:20:02.038206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 504/993] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:01 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:03.064490 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:03.065120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:03.071870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:03.072455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:03.072902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:03.073615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:03.074066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:03.074493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:03.209738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:03.217993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:03.219430 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:03.220779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-68fbdd6d-304d-49cb-bc39-f41ec907726f tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.161173 Sep 08 01:20:03.221333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 490/994] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:03 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:04.247159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:04.247766 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:04.254348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:04.254829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:04.255291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:04.255981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:04.256461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:04.256892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:04.261774 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:04.401756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:04.410299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:04.412067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:04.413259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4b847021-0520-48a0-80f0-0543fbcfbd70 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.170572 Sep 08 01:20:04.413809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 505/995] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:04 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:05.448696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:05.449265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:05.455570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:05.456039 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:05.456495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:05.457171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:05.457617 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:05.458036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:05.593401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:05.601378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:05.602784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:05.603954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d9e79941-5210-4813-9e18-6e65ff926b6d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.159626 Sep 08 01:20:05.604528 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 491/996] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:05 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:06.629536 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:06.630145 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:06.638963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:06.639463 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:06.639902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:06.640641 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:06.641099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:06.641532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:06.777672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:06.785739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:06.787191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:06.788390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-90ca09f6-70b7-4238-b427-490838831348 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.162733 Sep 08 01:20:06.788951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 506/997] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:06 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:07.814297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:07.815013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:07.821638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:07.823031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:07.823540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:07.824329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:07.824851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:07.825364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:07.960308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:07.971234 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:07.973158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:07.974991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-00f4be74-26c1-4a34-b329-807235607b3a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1673 microversion: 2.20 time: 0.164705 Sep 08 01:20:07.988692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 492/998] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:07 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:08.597593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de71e1a2-9046-453f-8852-32bcfc657758"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:08.600065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:08.606584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.607069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.607517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.608249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.608711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.609140 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.691957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments HTTP/1.1 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 74 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:20:08.693723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {"volumeAttachment": {"volumeId": "de71e1a2-9046-453f-8852-32bcfc657758"}} Sep 08 01:20:08.695150 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'server_id': 'e61087ac-46ab-4049-b1db-fed85fa93cf7', 'body': {'volumeAttachment': {'volumeId': 'de71e1a2-9046-453f-8852-32bcfc657758'}}} Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:08.696107 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:08.697494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 400 to user: Invalid volume: volume de71e1a2-9046-453f-8852-32bcfc657758 is already attached to instances: e61087ac-46ab-4049-b1db-fed85fa93cf7 {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-43ba7c88-3231-4386-b9ce-c64fe40dc3a3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101608 Sep 08 01:20:08.698784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 507/999] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:20:08 2022] POST /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:20:08.767028 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:08.767692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:08.774424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.774996 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.776298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.777263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.777819 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.778313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.861846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'services' on Instance uuid e61087ac-46ab-4049-b1db-fed85fa93cf7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:08.936873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2264e4fa-8249-437d-b290-39a3b3d6e5a0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments/de71e1a2-9046-453f-8852-32bcfc657758" status: 202 len: 0 microversion: 2.1 time: 0.174145 Sep 08 01:20:08.937577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 493/1000] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:20:08 2022] DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments/de71e1a2-9046-453f-8852-32bcfc657758 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:20:08.945903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:08.948862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:08.954773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.955435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.955754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.956567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:08.957112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:08.957606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:08.991045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-43e642c5-7dd7-40d3-8580-f4f36ec913f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048929 Sep 08 01:20:08.991530 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 508/1001] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:08 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:09.001949 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:09.002739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:09.009731 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:09.010417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:09.011036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:09.011740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:09.012215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:09.012644 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:09.179665 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:09.189386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:09.190903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:09.192107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2e3cbeee-de3d-417f-b54c-3703ab8374fe tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.194485 Sep 08 01:20:09.192921 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 494/1002] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:08 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:10.004335 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:10.006636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:10.013640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.014325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.014760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.015610 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.016065 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.016559 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.053404 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-db229c3e-67ed-4fd3-9944-f96bc3cea55c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053285 Sep 08 01:20:10.053964 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 509/1003] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:09 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:20:10.133762 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:10.135517 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:10.143443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.144298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.144997 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.145954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.146633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.147264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.180727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:20:10.219601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:10.220238 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:10.232716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.233697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.236537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.237377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.240970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.241666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.307443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a4d44b52-caa2-4e14-93b2-41242542ca58 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 204 len: 0 microversion: 2.1 time: 0.176575 Sep 08 01:20:10.308760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 495/1004] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:20:10 2022] DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:20:10.329396 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:10.332890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:10.348622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.349204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.354389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.354389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:10.354389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:10.354389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:10.381724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=6,nova_cell1:UPDATE=7 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:10.533293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:10.553277 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:10.558169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:10.560655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bbf98df1-124d-4d9b-a374-be67c19c40a1 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.345974 Sep 08 01:20:10.561989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 510/1005] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:10 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:10.597330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:10.606477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-41b71ee8-8364-4de0-9d9c-d1853d3c7efa tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.291944 Sep 08 01:20:10.607614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 496/1006] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:10 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:11.587049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:11.587783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:11.594388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:11.594948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:11.595399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:11.596191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:11.596573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:11.596996 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:11.632518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:11.633251 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:11.662172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:11.663011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:11.663539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:11.664374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:11.664902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:11.665406 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:11.769500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:11.781578 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:11.783095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:11.784416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a6980db6-31bf-44d9-8787-f686d81dba1e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.201197 Sep 08 01:20:11.791732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 511/1007] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:11 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:11.819280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:11.836813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3504b79f-88c0-4ca6-a82d-0c6540caff89 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.208139 Sep 08 01:20:11.838470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 497/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:11 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:12.813346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:12.814066 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:12.825746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:12.826295 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:12.827234 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:12.827627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:12.828449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:12.828960 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:12.862864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:12.863689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:12.871417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:12.871892 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:12.872369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:12.873085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:12.873543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:12.873969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:13.008265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:13.018370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:13.028989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:13.030489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ce3a811d-6387-4f02-b592-0609714e7ee2 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.221397 Sep 08 01:20:13.031459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 512/1009] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:12 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:13.084163 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:13.092700 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-035e7c25-53a8-4be4-a5a7-ddf8a14a4b6b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.233659 Sep 08 01:20:13.093635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 498/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:12 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:13.363714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-491520152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1893073206", "security_groups": [{"name": "tempest-secgroup-smoke-844461053"}], "networks": [{"uuid": "4c9e907a-44db-4b4e-bbd4-d602d71a8010"}], "block_device_mapping_v2": [{"uuid": "060e3455-0656-4507-ba12-f86a509d9a39", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:13.495707 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] validate_networks() for [('4c9e907a-44db-4b4e-bbd4-d602d71a8010', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:20:14.035714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:20:14.036394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:20:14.036614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:20:14.037020 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:20:14.037426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:20:14.047929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.048451 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.048880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.049595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.050051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.050469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.061050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:14.062390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:14.070393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.071257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Getting quotas for project e32dd1d6dcf54fbb83667953c4cbea29. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:20:14.075106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.075871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.076849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Getting quotas for user 00917dba4a9f4d56be3ec74f90a65154 and project e32dd1d6dcf54fbb83667953c4cbea29. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:20:14.077124 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.077798 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.078438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.142174 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:20:14.144376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='060e3455-0656-4507-ba12-f86a509d9a39',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:20:14.265158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:14.276716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:14.279335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:14.280757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e36cfa61-dac9-4f43-a0f3-92ea58e8b26a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.223542 Sep 08 01:20:14.281808 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 499/1011] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:14 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:14.287703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:14.288949 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:14.297245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.298016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.298828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.299748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:14.300389 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:14.301114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:14.341623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5946925e-be11-4d72-a48c-9e2a90ad5c72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.981774 Sep 08 01:20:14.346678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 513/1012] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:20:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 988 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:20:14.361982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9a740b0f-d0a2-4f6f-a0cd-c5a2166ff8c1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:14.363420 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9a740b0f-d0a2-4f6f-a0cd-c5a2166ff8c1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:14.434080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9a740b0f-d0a2-4f6f-a0cd-c5a2166ff8c1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:14.441625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9a740b0f-d0a2-4f6f-a0cd-c5a2166ff8c1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1088 microversion: 2.1 time: 0.087070 Sep 08 01:20:14.442857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 514/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:14 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:14.527157 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:14.545597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e6a50c3d-58f1-440c-8ea4-8271684ab08e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.262243 Sep 08 01:20:14.546175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 500/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:14 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:15.307358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:15.308028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:15.314642 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.315127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.315576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.316346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.316806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.317242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.460251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:15.466590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:15.467890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:15.470069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:15.472049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:15.474313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.474804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.475238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.475937 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.476403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.476826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.481589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-57279938-0bfc-49f8-a419-4efc0edece18 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.178220 Sep 08 01:20:15.500498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 515/1015] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:15 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:15.560803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:15.570461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:15.571103 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:15.575407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b5398dae-8a28-4d5b-864e-1d6deb9b40ac tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.113347 Sep 08 01:20:15.576111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 501/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:15 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:15.581713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.582196 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.582626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.583331 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:15.583778 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:15.584236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:15.737039 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:15.746845 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ae9ae3ee-a5a4-486d-b896-6f8567ff89a4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.181003 Sep 08 01:20:15.747629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 516/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:15 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:16.510404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:16.511269 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:16.517899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.518384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.518822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.519522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.520086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.520556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.599085 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:16.599866 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:16.607561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.608068 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.608942 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.609955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.610702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.611819 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.670012 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:16.678717 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:16.680221 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:16.682722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a7eb000f-d51d-49db-8533-c84f6dec7209 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.177030 Sep 08 01:20:16.692524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 502/1018] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:16 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:16.711962 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:16.721423 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4babb6c9-2fc9-4fb9-9630-7e3d671f0f72 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.126344 Sep 08 01:20:16.722101 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 517/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:16 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:16.770776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:16.771366 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:16.778334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.778821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.779258 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.779967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:16.780451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:16.780880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:16.925838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:16.933758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3c9622ac-17ab-4e48-b9ee-f978dacdebd8 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.166939 Sep 08 01:20:16.934522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 503/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:16 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:17.655855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:17.656547 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:17.663183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.663951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.664510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.665284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.665939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.666928 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.691712 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dc9dd171-8d37-4066-b834-7537cf81fb34 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/ips" status: 200 len: 145 microversion: 2.1 time: 0.039771 Sep 08 01:20:17.692314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 518/1021] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:20:17 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:17.708774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:17.709387 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:17.718104 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.718682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.719174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.719990 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.720529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.721210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.748777 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:17.749724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:17.756308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.757092 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.757771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.759114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.759900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.760564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.847444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:17.857491 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7f91dc7f-e6a6-414e-9501-7779dcf0d9f8 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.114312 Sep 08 01:20:17.861858 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 519/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:17 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:17.974737 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:17.975346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:17.987485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.988214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.988734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:17.989603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:17.990063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:17.990628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:18.005363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:18.016320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:18.018572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:18.020386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2d84d8af-ef53-47db-b436-50e8f04281f0 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.315566 Sep 08 01:20:18.035624 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 504/1023] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:17 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:18.223512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:18.242651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0f2a39d3-861f-4fef-af90-b8dc2e1344ea tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.288182 Sep 08 01:20:18.243318 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 520/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:17 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:18.886767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:18.888273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:18.896413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:18.896919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:18.897600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:18.898451 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:18.898973 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:18.899547 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:18.966786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:18.975037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8de6d032-9c2d-44cd-ae3f-402453872426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.093255 Sep 08 01:20:18.975595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 505/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:18 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:19.047368 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:19.047976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:19.054316 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.054792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.055222 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.055900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.056401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.056833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.185750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:19.193749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:19.195183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:19.196389 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e9d393e4-9fc5-4b52-8e89-b56fcae58a1c tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.152869 Sep 08 01:20:19.197238 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 521/1026] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:19 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:19.257715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a3389d9-1a39-4499-a8bf-16dcaf2afe8b"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:19.260734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:19.266832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.267320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.267758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.268505 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.268956 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.269379 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.271915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:19.272685 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:19.279095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.279572 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.280006 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.280724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:19.281177 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:19.281601 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:19.420104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:19.428012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5cd859ba-cf0b-49b3-880d-91f46599cfe5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.159889 Sep 08 01:20:19.428620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 522/1027] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:19 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:19.998780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:19.999438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:20.005462 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.005942 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.006380 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.007087 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.007546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.007983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.073841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:20.077229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:20.082151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4ff512af-5f59-450a-8917-8943999509a5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.087264 Sep 08 01:20:20.082714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 523/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:19 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:20.221294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:20.221856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:20.227915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.228434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.228878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.229567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.230026 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.230452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.359475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:20.367542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:20.369013 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:20.370179 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0b5d2f18-5bd3-4784-aa6e-588d6dae89e6 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.152812 Sep 08 01:20:20.370737 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 524/1029] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:20 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:20.451816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:20.452463 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:20.458333 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.458816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.459255 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.459944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:20.460429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:20.460858 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:20.591935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:20.599645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7e47d6c4-6fce-4a59-bc30-aa1f2c3fe4ad tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.152348 Sep 08 01:20:20.600237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 525/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:20 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:21.105816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:21.106469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:21.112987 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.113502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.113941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.114635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.115091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.115519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.175665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:21.183930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fda3fce6-496b-46a6-bc92-0278b0692434 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.082597 Sep 08 01:20:21.184532 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 526/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:21 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:21.396394 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:21.396944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:21.403786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.404298 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.404732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.405409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.405860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.406281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.533734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:21.542452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:21.543997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:21.545192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7cf59ed8-546a-4141-b619-cfa866a423f3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.152855 Sep 08 01:20:21.545753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 527/1032] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:21 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:21.623256 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:21.623865 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:21.630759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.631243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.631678 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.632400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:21.632857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:21.633285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:21.768312 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:21.776008 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e6c479dd-47ad-4c7f-b0a9-0d8180f81d7b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.157071 Sep 08 01:20:21.776589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 528/1033] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:21 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:22.206300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:22.206957 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:22.214310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.214809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.215495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.216587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.217049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.217490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.279266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:22.287625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fb03c873-f90c-4d6d-83a3-d6b4b7fdc561 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1138 microversion: 2.1 time: 0.085146 Sep 08 01:20:22.288215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 529/1034] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:22 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:22.570377 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:22.571086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:22.577884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.578360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.578796 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.579470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.579917 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.580379 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.707986 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:22.716086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:22.717571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:22.718747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-baab8ab3-1a1a-4cad-8fec-652dc169dcb4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.152322 Sep 08 01:20:22.719315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 530/1035] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:22 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:22.799716 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:22.800361 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:22.806812 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.807301 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.807836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.808558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:22.809021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:22.809453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:22.941508 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:22.950286 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-03660518-5dab-4ebc-aac4-cf55182997b4 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.154334 Sep 08 01:20:22.950854 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 531/1036] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:22 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:23.311457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:23.312123 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:23.318511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.318990 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.319422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:23.320104 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.320576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.320994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:23.381031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:23.389745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-285937a9-e3ed-47ff-8ce2-9f0917946697 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1130 microversion: 2.1 time: 0.082817 Sep 08 01:20:23.390317 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 532/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:23 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1130 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:23.744871 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:23.745474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:23.751344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.751815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.752274 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:23.752956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.753406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.753823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:23.883188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:23.892289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:23.893654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:23.894799 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2b30c9e3-f502-4f4d-b486-2d95991c7811 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.154183 Sep 08 01:20:23.895371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 533/1038] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:23 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:23.972562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:23.973176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:23.979652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.980157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.980630 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:23.981328 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:23.981783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:23.982210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:24.059983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:24.111983 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:24.119541 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e29de27-f107-4db2-9ddd-25e81ae30da3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1679 microversion: 2.1 time: 0.150822 Sep 08 01:20:24.120096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 534/1039] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:23 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:24.379974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d4ec3036-d3a8-422f-acdb-9a14a3450653 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.125832 Sep 08 01:20:24.380677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 506/1040] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:20:19 2022] POST /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 194 bytes in 5128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:20:24.412734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:24.413400 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:24.419903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:24.420424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:24.420861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:24.421670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:24.422128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:24.422546 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:24.438381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=8 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:24.485425 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:24.493030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7e54b367-2155-4445-bb06-f302e9f7e1a4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1186 microversion: 2.1 time: 0.084163 Sep 08 01:20:24.493594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 535/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:24 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:24.923764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:24.924484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:24.931383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:24.931931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:24.932485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:24.933803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:24.934931 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:24.935404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.134341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.143851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:25.144298 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.145171 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:25.145730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.147112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a2857643-9e81-42e7-a772-8d6b413ae754 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.229780 Sep 08 01:20:25.147981 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 507/1042] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:24 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:25.163711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.165088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.166763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.168770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.169271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.169884 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.252645 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.264357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-710236d5-4aea-4bef-8f0b-904f31486df6 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1612 microversion: 2.1 time: 0.124754 Sep 08 01:20:25.266323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 536/1043] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:25 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1612 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:25.477667 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:25.478732 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:25.487359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.488036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.488529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.489768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.490374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.490821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.517195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:25.517784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:25.518638 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:20:25.523878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.524414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.524856 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.525558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.526007 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.526469 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.606971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d30a0c9b-b4bd-4d5b-a8ee-7c922eaa349d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "DELETE /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 204 len: 0 microversion: 2.1 time: 0.133541 Sep 08 01:20:25.608168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.608639 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 508/1044] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:20:25 2022] DELETE /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:20:25.619086 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e61ac9dd-ea7c-454d-aced-c3772cf9294d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1204 microversion: 2.1 time: 0.105662 Sep 08 01:20:25.622147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 537/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:25 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1204 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:25.625144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:25.626082 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:25.632904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.633894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.634677 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.636791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.637585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.638227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.764124 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e61087ac-46ab-4049-b1db-fed85fa93cf7", "name": "network-vif-deleted", "tag": "aaddf7ea-b169-49c2-8975-6d2c99ba8401"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:25.776680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:25.777304 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:25.778230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:25.799507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] Creating event network-vif-deleted:aaddf7ea-b169-49c2-8975-6d2c99ba8401 for instance e61087ac-46ab-4049-b1db-fed85fa93cf7 on hv-cinder-84773 Sep 08 01:20:25.805555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-80210996-fc24-42ff-a167-2d8712aa9e45 req-64691f41-991a-4c78-b4f2-914735699b6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048107 Sep 08 01:20:25.806567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 538/1046] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:20:25.854550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:25.858483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:25.864966 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce55c3cf-0aed-4c52-ad3e-ca092346c868 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1576 microversion: 2.1 time: 0.248387 Sep 08 01:20:25.865607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 509/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:25 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:26.184202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:26.184899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:26.201670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.202461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.203057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.203955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.204619 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.205204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.297469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:26.298736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:26.308514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.309411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.310040 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.312002 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.312795 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.313641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.382233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:26.397471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:26.399475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:26.400923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4f2da264-8810-4999-92af-edb24df8c4e3 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.222005 Sep 08 01:20:26.410017 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 539/1048] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:26 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:26.483578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:26.493250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-711d87fb-c5c1-42cc-9cb7-ad160168deac tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1612 microversion: 2.1 time: 0.206679 Sep 08 01:20:26.509813 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 510/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:26 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1612 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:26.646953 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:26.647693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:26.656383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:26.657924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.658588 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.659113 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.661611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.662604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.663143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.820531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:26.829506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7cd1b332-a25f-4655-b892-935b8852b009 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.186505 Sep 08 01:20:26.830099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 540/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:26 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:26.889938 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:26.890585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:26.898301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.898888 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.899537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:26.900356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:26.900890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:26.901469 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.146099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:27.157359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e89fc867-06b2-488c-a60d-e7bbe72363e2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1576 microversion: 2.1 time: 0.271893 Sep 08 01:20:27.158313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 511/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:26 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1576 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:27.427445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:27.428054 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:27.435568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.436055 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.436513 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.437221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.437671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.438096 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.442282 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:27.522888 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:27.523483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:27.525782 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:27.534633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.535465 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.535905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.536642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.537098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.537525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.602286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.603033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.603724 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.605311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid e61087ac-46ab-4049-b1db-fed85fa93cf7 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:27.612059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:27.639453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:27.640944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:27.642142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-82e3c441-dc08-4ef9-8e70-66f5a857376e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.218666 Sep 08 01:20:27.653925 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 541/1052] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:27 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:27.690657 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:27.700650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1dbfc834-d889-4eae-8c0e-2fc5e1bba838 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 200 len: 1330 microversion: 2.1 time: 0.181435 Sep 08 01:20:27.701229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 512/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:27 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 1330 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:27.854261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:27.855762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:27.863129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.863848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.864374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.865207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.865950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.866571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.922525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:27.951640 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:27.952121 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:27.952572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:27.968650 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] Creating event network-changed:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:20:27.990176 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-a801942e-dc58-44d5-9f2e-56f12378a77c req-25ba6913-16ba-4a25-aead-0a86066d3316 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071270 Sep 08 01:20:27.993187 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 513/1054] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:28.021188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:28.029738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa440a03-baf0-4909-9e2f-c2fb5861017c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.180632 Sep 08 01:20:28.030897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 542/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:27 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:28.181354 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:28.181979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:28.188357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.189119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.189557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.190488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.191094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.191668 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.232279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "name": "network-vif-plugged", "status": "completed", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:28.252324 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.253383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.254139 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.269594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] Creating event network-vif-plugged:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:20:28.276015 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-6671c871-79a8-44d3-a3c9-5042ccf759f8 req-59cf8143-b0d2-48b7-a99b-a5da5bea8dd8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047980 Sep 08 01:20:28.277752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 543/1056] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:28.570725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:28.579111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8c0f35c1-2df8-4be5-a452-60caf8bb4209 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1576 microversion: 2.1 time: 0.402000 Sep 08 01:20:28.579792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 514/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:28 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1576 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:28.669540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:28.670329 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:28.677669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.677669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.677669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.679638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.680252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.680585 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.723142 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:28.724195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:28.746042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.746604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.747053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.747823 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:28.748306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:28.751416 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:28.769005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 HTTP/1.1 Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:20:28.770685 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:20:28.772215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'e61087ac-46ab-4049-b1db-fed85fa93cf7'} Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:28.773058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:20:28.774357 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:28.775587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:28.775587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-869930c9-0ab5-4ff6-afbc-4e68c5efb55f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 404 len: 111 microversion: 2.1 time: 0.053223 Sep 08 01:20:28.775587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 515/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:28 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:20:28.780876 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d0f109b6-da68-4311-bf7c-1153a455d695 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '.version_select at 0x7fe9c9e4c700>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:28.802246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d0f109b6-da68-4311-bf7c-1153a455d695 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-351030552" status: 202 len: 0 microversion: 2.1 time: 0.024902 Sep 08 01:20:28.806540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 516/1059] 10.222.0.42 () {58 vars in 1218 bytes} [Thu Sep 8 01:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-351030552 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:20:28.879909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:28.889430 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:28.891019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:28.892353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b3e02ab2-0386-4cc1-96d5-02daa89bdbe4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.228122 Sep 08 01:20:28.909353 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 544/1060] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:28 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:29.054384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:29.055094 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:29.062609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.063351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.063856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:29.064775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.065871 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.066377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:29.226679 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:29.235889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1a8c80b4-7882-48e4-be80-d1c00f0d1f03 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.185493 Sep 08 01:20:29.237079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 517/1061] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:29 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:29.537284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a581ad46-beb5-465b-be16-bde80edb8d0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: .version_select at 0x7fe9c9c60040>, body: {"keypair": {"name": "tempest-keypair-1720515526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVDDcODnYmUWf1RgonFV76Gr480n1TA1AfchiW2do33YK5ioqDxtgqikGIZOFyZ/t1RIPXcAu2ZUnDI886wWcwl6bU543MwyWJEvE3wHiZ0C4mOrbk85i8xCwpcDrL6aQ=="}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:29.552852 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-a581ad46-beb5-465b-be16-bde80edb8d0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:20:29.556687 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-a581ad46-beb5-465b-be16-bde80edb8d0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'key_pairs'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:20:29.578558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a581ad46-beb5-465b-be16-bde80edb8d0d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045072 Sep 08 01:20:29.579170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 545/1062] 10.222.0.42 () {60 vars in 1159 bytes} [Thu Sep 8 01:20:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:29.603088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:29.603948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:29.611081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.611814 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.612273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:29.612977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.613607 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.614277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:29.693494 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:29.702290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-747d54ec-b336-40f2-9d73-0968ceef1092 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1510 microversion: 2.1 time: 0.102962 Sep 08 01:20:29.702862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 518/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:29 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1510 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:29.927749 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:29.928415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:29.940181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.940759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.941211 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:29.941933 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:29.942395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:29.942836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.034180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585aa54c-7191-4b3d-bc77-4adf1090b504", "name": "network-vif-deleted", "tag": "15a42ea1-d5cf-46a9-9ba0-f0879233878a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:30.046049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:30.046889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:30.047485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.062970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] Creating event network-vif-deleted:15a42ea1-d5cf-46a9-9ba0-f0879233878a for instance 585aa54c-7191-4b3d-bc77-4adf1090b504 on hv-cinder-84773 Sep 08 01:20:30.068520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-c9839a8e-2943-4ad1-b43b-b0d28ecbf985 req-45f77749-a6ab-40dd-bb2b-32443bae8e6c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037977 Sep 08 01:20:30.073020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 519/1064] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:20:30.150784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:30.162336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:30.164229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:30.165497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1977ccd1-d07a-4bbf-b334-e9b3dce04b7b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.250929 Sep 08 01:20:30.166268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 546/1065] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:29 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:30.261727 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:30.262554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:30.269214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:30.269645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:30.270084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.270789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:30.271246 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:30.271672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.415633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:30.423747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-03b396c9-dc24-4ed1-88db-25d858bb3c0e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.167031 Sep 08 01:20:30.424355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 520/1066] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:30 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:30.726548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:30.727273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:30.734397 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:30.734951 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:30.735387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.736073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:30.736554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:30.736975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:30.821662 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:30.830268 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6023074f-c322-47ae-bbe0-aeaccfcc7e82 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1510 microversion: 2.1 time: 0.107469 Sep 08 01:20:30.830771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 547/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:30 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1510 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:30.993014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1058607909", "imageRef": "73619b2f-b070-4bc1-8b6a-cc7729dfec01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e9407ec-0cf4-40eb-abcb-b44e26ace243"}], "security_groups": [{"name": "tempest-securitygroup--2111942635"}], "key_name": "tempest-keypair-1720515526", "user_data": "}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:31.095088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] validate_networks() for [('9e9407ec-0cf4-40eb-abcb-b44e26ace243', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:20:31.190762 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:31.191367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:31.197868 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.199010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.199447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.200129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.200602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.201022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.361558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.369725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.371801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.373012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f0ff4fd3-e338-4965-9b6a-b75bbd5b6bc9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.186090 Sep 08 01:20:31.373582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 548/1068] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:31 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:31.446848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:31.447459 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:31.454002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.454496 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.455551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.462889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.463913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.463913 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.628701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:20:31.629701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:20:31.630175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:20:31.630582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:20:31.631160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:20:31.636952 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.641207 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.641682 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.642113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.642830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.643291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.643683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.644665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6e5753f3-647b-4637-b4db-3347417b02e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.201707 Sep 08 01:20:31.645212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 549/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:31 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:31.661140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:20:31.665036 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Getting quotas for user 83fea9762aaf4766a23f1774ff1411fe and project e856bb81a717482cbea65029d521700d. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:20:31.676561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:20:31.678844 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='73619b2f-b070-4bc1-8b6a-cc7729dfec01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:20:31.726532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6816052e-7341-4a21-b76e-7e619fb8b53d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737750 Sep 08 01:20:31.727170 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 521/1070] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:20:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:20:31.739060 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-813a8f3d-e7de-4504-80aa-7ee0dbea9266 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:31.739654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-813a8f3d-e7de-4504-80aa-7ee0dbea9266 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:31.802359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-813a8f3d-e7de-4504-80aa-7ee0dbea9266 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.815421 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-813a8f3d-e7de-4504-80aa-7ee0dbea9266 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1242 microversion: 2.1 time: 0.079369 Sep 08 01:20:31.816043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 550/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:31 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:31.853615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:31.854236 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:31.861585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.862103 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.862537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.863231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:31.863683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:31.864109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:31.937683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:31.947018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d2e4ac02-2d4e-41d0-99a1-4390ee827076 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1225 microversion: 2.1 time: 0.097818 Sep 08 01:20:31.947659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 522/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:31 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:32.398997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:32.399652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:32.407226 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.407729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.408190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.408897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.409411 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.409857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.541752 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:32.550033 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:32.551484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:32.552724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6f6a195d-7ef6-4356-bd5e-9fdd95d03607 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.158343 Sep 08 01:20:32.553283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 551/1073] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:32 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:32.668352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:32.669009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:32.676411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.677148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.677659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.678352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.678805 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.679229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.818072 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:32.826041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1150e801-54fb-497f-aee8-7f8b2af25b4f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.162882 Sep 08 01:20:32.826615 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 523/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:32 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:32.838974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:32.839677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:32.873727 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.880816 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.881485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.883932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.884639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.885237 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.957950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:32.969617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-117102d6-4d53-4423-b4c1-cce0f47d99cb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1238 microversion: 2.1 time: 0.134424 Sep 08 01:20:32.970667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 552/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:32 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:32.971101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:32.971912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:32.977833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.978482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.979167 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:32.980807 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:32.981606 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:32.982245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.050684 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.051368 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.051810 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.052293 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lazy-loading 'fault' on Instance uuid 585aa54c-7191-4b3d-bc77-4adf1090b504 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:33.121224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:33.121835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:33.124683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:33.133202 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3cc9cd7a-731c-4af9-bb5a-56815842f545 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1230 microversion: 2.1 time: 0.165895 Sep 08 01:20:33.134207 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.135092 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 524/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:32 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1230 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:33.155419 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.156597 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.157945 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.158768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.159424 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.199848 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6553634e-0097-4939-84cd-e9607abfea36 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083282 Sep 08 01:20:33.200930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 553/1077] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:33 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:33.211767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:33.212302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:33.219283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.219765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.220301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.220993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.221440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.221861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.252446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7fc44b0d-9cb9-4b08-8d3d-894777f7c5fd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b" status: 200 len: 194 microversion: 2.1 time: 0.044528 Sep 08 01:20:33.253059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 525/1078] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 8 01:20:33 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:33.579880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:33.583830 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:33.598239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.598992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.600005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.601605 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.602839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.603515 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.784151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:33.794163 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:33.795831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:33.797132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4707248e-f6d0-44e2-b389-71b098ea1633 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1731 microversion: 2.20 time: 0.221499 Sep 08 01:20:33.797783 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 554/1079] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:33 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1731 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:20:33.850365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:33.850993 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:33.859133 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.859660 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.860099 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.861029 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:33.861619 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:33.862290 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:33.994151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:33.995005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:34.004259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.005232 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.005787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.006562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.007109 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.008146 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.084048 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:34.093567 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-917b2ec9-8413-4f05-8536-c236810e8bf1 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1238 microversion: 2.1 time: 0.103311 Sep 08 01:20:34.094810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 555/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:33 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:34.164461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:34.165090 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:34.185867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.194127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.195947 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.200077 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.201160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.206012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.282710 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.285055 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.286035 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.288859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lazy-loading 'fault' on Instance uuid 585aa54c-7191-4b3d-bc77-4adf1090b504 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:34.346312 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:34.360321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8e0f1de3-1e8f-41b0-87ac-2fd886f0bd69 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 200 len: 1230 microversion: 2.1 time: 0.203486 Sep 08 01:20:34.361555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 556/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:34 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 1230 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:34.376590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:34.382872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eb95240e-631f-4a8e-8176-50fcd9a2990a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1271 microversion: 2.1 time: 0.536500 Sep 08 01:20:34.383876 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 526/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:33 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1271 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:34.657162 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c25cc57-2bb3-4732-84fc-340229b01a74"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:34.659864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:34.666617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.667864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.667864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.668387 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.668838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.669261 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.824898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:34.825881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:34.834138 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.835046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.835495 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:34.836301 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:34.836754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:34.837175 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.006951 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:35.016647 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:35.018117 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:35.019285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7236cbb7-357f-4159-960e-4caae1e396f9 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1718 microversion: 2.20 time: 0.200021 Sep 08 01:20:35.019825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 527/1083] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:20:34 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1718 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:20:35.043381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5df596c9-7e2f-407f-9c24-b3b4a3dbaa37 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "POST /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390245 Sep 08 01:20:35.043993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 557/1084] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:20:34 2022] POST /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:35.118330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:35.118889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:35.126100 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.126586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.127020 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.127716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.128457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.129190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.204253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:35.212735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bcab0e4b-63c8-4f7c-8bd8-9c9f0b950c19 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1294 microversion: 2.1 time: 0.098399 Sep 08 01:20:35.213827 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 528/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:35 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1294 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:35.390246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:35.390912 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:35.398051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.398684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.399137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.399889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.400415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.400864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.407067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:35.407833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:35.414443 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.414930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.415375 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.416161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:35.416611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:35.417043 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:35.425973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] HTTP exception thrown: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Request method failure captured: Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 HTTP/1.1 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUKkd26l2JiFlASENj34o15D6JdzP4M3MSGUTC0p6onOQtY1glF6D9dU3iCwPWsJkCEnB-CLhdQ6ODgklCPvw0HTfwPv8eWOxp_cgrL-46iw8zhnrJRL7Ktcm421yYsRa6TBF8pb3zP_5mOsqu2wKgPdb3_tWfhy_bWTekoLAuJQka8 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:20:35.427626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4221b10efb3d4bb799d820e985a48651", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4221b10efb3d4bb799d820e985a48651"}]}] Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestVolumeBootPattern-599965185 Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 744fe07ea5644157bdbf11d81adbab89 Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:20:35.429041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '585aa54c-7191-4b3d-bc77-4adf1090b504'} Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:35.429831 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:20:35.431072 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:35.432223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Returning 404 to user: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:35.432223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f039646d-09dd-44cd-b92a-ddbdf66dd492 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 404 len: 111 microversion: 2.1 time: 0.044677 Sep 08 01:20:35.432223 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 558/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:35 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:20:35.436435 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:35.541426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1464761088", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979447183", "security_groups": [{"name": "tempest-secgroup-smoke-18365749"}], "block_device_mapping_v2": [{"uuid": "0a38f1a5-3ccc-4dc2-98af-58f6bca09b35", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5"}]}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:35.566960 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:35.575563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-87cba0eb-61ad-4b87-a730-818ffc83a8f1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.172486 Sep 08 01:20:35.576158 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 529/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:35 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:35.680859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.network.neutron [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] validate_networks() for [('57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5', None, None, None, None, None)] {{(pid=120715) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:20:36.242601 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:36.243209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:36.251420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.253632 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.254300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.255215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.256365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.256965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.332695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:36.341211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-638d6e55-9c95-4db3-90f1-2545f942d712 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1300 microversion: 2.1 time: 0.102377 Sep 08 01:20:36.341972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 530/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:36 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:36.489631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:20:36.490063 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image limits 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:20:36.490724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:20:36.491143 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image pref 0:0:0 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:20:36.491562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.virt.hardware [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120715) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:20:36.500832 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.501215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.501655 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.502589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.503221 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.503654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.521885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:20:36.527093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.quota [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for user 744fe07ea5644157bdbf11d81adbab89 and project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120715) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:20:36.594663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Going to run 1 instances... {{(pid=120715) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:20:36.596984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a38f1a5-3ccc-4dc2-98af-58f6bca09b35',volume_size=None,volume_type=None)] {{(pid=120715) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:20:36.602785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:36.603378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:36.611884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.613329 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.613840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.614736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:36.615224 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:36.615683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:36.782944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-efff6794-65d5-4061-9853-703abefcfe4b tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.245207 Sep 08 01:20:36.784573 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 559/1089] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:20:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 01:20:36.797930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8180a6e3-fc9e-4aaa-a240-45ea8bfedcc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:36.798970 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8180a6e3-fc9e-4aaa-a240-45ea8bfedcc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:36.841633 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:36.857280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eacc507c-3af5-4f47-94c3-ba9dc2603b90 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.262609 Sep 08 01:20:36.858801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 531/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:36 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:36.872654 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8180a6e3-fc9e-4aaa-a240-45ea8bfedcc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:36.881461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8180a6e3-fc9e-4aaa-a240-45ea8bfedcc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1094 microversion: 2.1 time: 0.088212 Sep 08 01:20:36.882522 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 560/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:36 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:37.367287 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:37.367898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:37.390372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.390870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.391306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.392031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.392499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.392925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.623154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:37.632525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8498ee0d-5f96-480a-a4ca-2d8551cdf8e7 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.269846 Sep 08 01:20:37.633194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 532/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:37 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:37.674212 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4397e20e-3510-4537-a2fd-85cd217071b3", "tag": "5c90b0ad-5d68-4ad9-951d-7ea04741062a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:37.688956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.690322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.691041 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.697239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:37.707773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] Creating event network-changed:5c90b0ad-5d68-4ad9-951d-7ea04741062a for instance 4397e20e-3510-4537-a2fd-85cd217071b3 on hv-cinder-84773 Sep 08 01:20:37.713284 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-5c867302-753d-4dcf-8c20-b2ed2aab7e05 req-1c62a9ea-9c3d-4f3e-bff5-0b7e035c0f4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042756 Sep 08 01:20:37.714151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 561/1093] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:37.882766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:37.883634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:37.890090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.890731 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.891011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.891680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.892120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.892571 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.906714 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:37.908289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:37.915928 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.916756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.917314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.918315 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:37.919439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:37.919972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:37.988422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:37.996841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d1a24909-c45e-4a59-8745-dd78fac51e42 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1192 microversion: 2.1 time: 0.094200 Sep 08 01:20:37.997416 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 562/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:37 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:38.072195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:38.083823 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fb2da674-45e5-4478-aedd-7a420c3b3c3f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.201510 Sep 08 01:20:38.094970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 533/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:37 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:38.663010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:38.663949 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:38.672229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:38.673031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:38.673551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:38.674444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:38.675118 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:38.675769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:38.894922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:38.905012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2e60b02c-a793-4333-b384-3eedea354587 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.246265 Sep 08 01:20:38.906110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 563/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:38 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:39.022562 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:39.023738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:39.031096 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.031825 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.032454 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:39.033316 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.034132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.034721 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:39.114972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:39.116958 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:39.127291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.128112 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.128855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:39.130149 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.130973 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.131594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:39.238208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:39.247849 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-342f5f6a-d534-4209-9ade-be9d5a12a5c3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1276 microversion: 2.1 time: 0.230021 Sep 08 01:20:39.261508 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 534/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:39 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:39.313656 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:39.324051 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-dab9dd1d-dce1-4331-b3aa-17ee5e21e7e1 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.219827 Sep 08 01:20:39.325381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 564/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:39 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:39.937041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:39.938089 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:39.951240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.953487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.955509 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:39.957618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:39.966286 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:39.966865 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.118029 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:40.131309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5ab54afa-a172-4f0e-98eb-ada57c95b775 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.205383 Sep 08 01:20:40.131816 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 535/1099] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:39 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:40.189135 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7941f2c-2db7-48f4-9349-520db58e9b22", "tag": "65a31114-bf80-4207-9670-9083d449f4b7"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:40.200540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:40.201299 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:40.201734 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.215385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] Creating event network-changed:65a31114-bf80-4207-9670-9083d449f4b7 for instance d7941f2c-2db7-48f4-9349-520db58e9b22 on hv-cinder-84773 Sep 08 01:20:40.221050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-906d6e81-d407-404f-8803-7466770f3e70 req-3b659970-2b12-43f7-bfc4-6948bd05b145 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035427 Sep 08 01:20:40.222093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 565/1100] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:40.273252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:40.274157 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:40.281152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:40.281686 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:40.282429 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.283669 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:40.284557 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:40.285365 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.353524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:40.354911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:40.361273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:40.361761 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:40.362201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.362910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:40.363363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:40.363791 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:40.423676 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:40.431361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-44dd222f-9201-486c-99c9-63a0d887f406 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1276 microversion: 2.1 time: 0.162249 Sep 08 01:20:40.431915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 536/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:40 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:40.499833 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:40.507544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15676a70-0d6c-4b99-8912-e95f06378649 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.159139 Sep 08 01:20:40.508108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 566/1102] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:40 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:41.155373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:41.155979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:41.162337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.162789 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.163214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.163898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.164558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.164777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.304725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:41.313412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a1db364f-4462-4519-8f6e-6aa9aa3fd523 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.162259 Sep 08 01:20:41.313992 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 537/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:41 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:41.454801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:41.455494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:41.462188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.462671 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.463110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.463930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.464412 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.464843 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.531961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:41.532623 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:41.538720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.539201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.539821 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.540560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:41.541296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:41.541942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:41.608646 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:41.616080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-18c9e7d0-df84-489a-b6da-235a9a958d65 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1276 microversion: 2.1 time: 0.164945 Sep 08 01:20:41.616857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 567/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:41 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:41.649675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:41.672969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=6 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:41.695264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:41.703882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-33f537ef-d1f1-4615-8642-0580ffa45905 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.176118 Sep 08 01:20:41.704488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 538/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:41 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:42.336592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:42.337322 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:42.343539 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.344020 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.344502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.345205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.345659 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.346093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.483293 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:42.491550 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e5efd10d-c8fd-4a93-996f-d10444e446f5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.158742 Sep 08 01:20:42.492155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 568/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:42 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:42.639377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:42.639998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:42.647502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.647988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.648470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.649169 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.649622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.650050 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.726673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:42.727456 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:42.734878 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.735815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.736639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.737780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:42.738591 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:42.739340 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:42.820776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:42.829750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dd9422ed-27b7-4eea-b515-608cd863e089 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1276 microversion: 2.1 time: 0.194475 Sep 08 01:20:42.830424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 539/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:42 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1276 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:42.892628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:42.900399 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-fad08c10-cf2d-4e08-98d4-3d0c323583cd tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.177805 Sep 08 01:20:42.906199 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 569/1108] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:42 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:43.515961 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:43.516786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:43.523032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.523766 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.524349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.525123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.525695 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.526818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.661681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:43.669440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-677cfea3-a8c4-4314-8eeb-29e17d9920d2 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.157329 Sep 08 01:20:43.670007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 540/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:43 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:43.804205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:43.806611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:43.813554 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.814040 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.814480 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.815175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.815626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.816052 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.846794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d70ed43-7812-4866-8715-08a732aa920d tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046464 Sep 08 01:20:43.847356 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 570/1110] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:43 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:43.853139 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:43.853759 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:43.859866 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.860390 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.860834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.861521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.861972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.862402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.924373 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:43.925367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:43.931442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.932684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.933227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:43.934437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:43.935392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:43.935531 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.006254 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:44.016264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8ec6d75a-3d75-42e8-8125-460f6e3bf4d5 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.166953 Sep 08 01:20:44.017182 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 541/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:43 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:44.022628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:44.023113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:44.030250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.030935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.031524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.032399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.033005 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.033581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.066570 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-91330c9a-ef67-49f4-a4b3-d0a4d26f7d31 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b" status: 200 len: 194 microversion: 2.1 time: 0.048166 Sep 08 01:20:44.067409 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 542/1112] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 8 01:20:44 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:44.079245 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:44.079930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:44.085965 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.086658 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.087343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.088090 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.090162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.090597 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.096127 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:44.105689 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-14489d2e-864f-4926-b33e-10c1e15008be tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.185329 Sep 08 01:20:44.107248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 571/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:43 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:44.112450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "name": "network-vif-plugged", "status": "completed", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:44.121753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.122692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.123393 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.138446 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] Creating event network-vif-plugged:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:20:44.143767 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-0e65cfb0-929c-49ee-bab4-01c87329353a req-7a901149-fb6c-42bf-98d7-cc5dc3b52e44 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035126 Sep 08 01:20:44.144542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 572/1114] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:44.179423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lazy-loading 'services' on Instance uuid 24f46ee2-3552-464f-81dc-f5981ed0b275 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:44.259131 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa313845-baf6-4768-8335-8b99617f0794 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b" status: 202 len: 0 microversion: 2.1 time: 0.184000 Sep 08 01:20:44.259718 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 543/1115] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:20:44 2022] DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/2a3389d9-1a39-4499-a8bf-16dcaf2afe8b => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:20:44.693981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:44.694720 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:44.701447 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.701926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.702363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.703047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:44.703500 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:44.703926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:44.838285 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:44.845924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ec3afd33-daf9-4168-baa5-5753d2a58531 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.156216 Sep 08 01:20:44.846493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 573/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:44 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:45.040594 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:45.041872 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:45.048199 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.048680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.049113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.049798 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.050250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.050675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.130684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:45.130939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:45.135028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:45.140617 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.141108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.141545 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.142239 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.142693 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.143119 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.188101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:45.196500 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e2b4e342-97ca-4a42-8698-3417fd615c12 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.160566 Sep 08 01:20:45.197161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 544/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:45 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:45.274862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:45.283170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2b21462e-6ba4-4d8a-ab07-c894a3ba9229 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1259 microversion: 2.1 time: 0.156844 Sep 08 01:20:45.283728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 574/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:45 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:45.869326 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:45.869942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:45.875885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.876402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.876838 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.877519 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:45.877968 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:45.878386 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:45.896918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:46.016309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:46.028080 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9c6d1694-3d2a-46ff-8961-95a65315d490 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.162672 Sep 08 01:20:46.028753 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 545/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:45 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:46.165899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4397e20e-3510-4537-a2fd-85cd217071b3", "name": "network-vif-plugged", "status": "completed", "tag": "5c90b0ad-5d68-4ad9-951d-7ea04741062a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:46.175763 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.176273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.176702 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.188623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] Creating event network-vif-plugged:5c90b0ad-5d68-4ad9-951d-7ea04741062a for instance 4397e20e-3510-4537-a2fd-85cd217071b3 on hv-cinder-84773 Sep 08 01:20:46.194108 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-636628ad-a26c-414e-bafc-f7c74e0d25ce req-d2e3b70a-7ea5-42c4-b3b3-b6505b1a1d8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Sep 08 01:20:46.195003 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 575/1120] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:46.220302 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:46.220934 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:46.227317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.227794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.228262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.228955 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.229745 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.230168 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.307584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:46.308652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:46.314794 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.315348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.315855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.316709 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.317202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.317698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.384262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:46.392267 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9968e5ad-e544-4450-becd-7c81a8dff799 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.175802 Sep 08 01:20:46.393109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 546/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:46 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:46.444774 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:46.445264 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:46.451364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.451846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.452306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.452991 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.453437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.453854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.461209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:46.469445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bfc35320-fbd6-4eb2-b253-ee3c6dfc2b7f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1442 microversion: 2.1 time: 0.166679 Sep 08 01:20:46.470028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 576/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:46 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1442 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:46.490001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-245e9e2b-2a58-4903-8158-5042ec106997 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/4c25cc57-2bb3-4732-84fc-340229b01a74" status: 200 len: 194 microversion: 2.1 time: 0.049123 Sep 08 01:20:46.490929 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 547/1123] 10.222.0.42 () {58 vars in 1413 bytes} [Thu Sep 8 01:20:46 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/4c25cc57-2bb3-4732-84fc-340229b01a74 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:20:46.493036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:46.493839 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:46.501583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.502058 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.502487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.502591 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:46.503033 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:46.503204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.503786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.504230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.509107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.509593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.510114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.510908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:46.511479 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:46.511912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:46.521308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:46.610953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lazy-loading 'services' on Instance uuid 24f46ee2-3552-464f-81dc-f5981ed0b275 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:46.664638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:46.674031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-31f89e1d-1e3f-435c-9e52-7a2e8754134f tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1442 microversion: 2.1 time: 0.185521 Sep 08 01:20:46.674759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 577/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:46 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1442 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:46.712499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-55d1e5c2-55c8-42b5-9d80-92bdb21a99dc tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/4c25cc57-2bb3-4732-84fc-340229b01a74" status: 202 len: 0 microversion: 2.1 time: 0.213562 Sep 08 01:20:46.713610 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 548/1125] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:20:46 2022] DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments/4c25cc57-2bb3-4732-84fc-340229b01a74 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:20:47.050841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:47.051457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:47.053325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=14 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:47.058692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:47.059175 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:47.059614 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:47.060348 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:47.060806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:47.061240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:47.216618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:47.227246 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5a466d4b-cd8a-43e7-b5dc-b9187573dc4f tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.180186 Sep 08 01:20:47.227940 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 578/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:47 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:47.416513 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:47.417228 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:47.423417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:47.423899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:47.424383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:47.425074 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:47.425524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:47.425947 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:47.651634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:47.659368 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-038c01f0-124e-4f3c-9823-28b917821dfc tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.247644 Sep 08 01:20:47.659924 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 549/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:47 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:48.250358 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:48.251609 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:48.260632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.261391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.261997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.262881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.263496 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.264093 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.427544 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:48.435991 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4847be9e-01a3-4413-8c80-791a5aeb7e76 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1368 microversion: 2.1 time: 0.189562 Sep 08 01:20:48.436906 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 579/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:48 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:48.682507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:48.683314 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:48.689941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.690425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.691049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.691830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.692316 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.692741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.805994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:48.817680 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.818413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.819069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.839095 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] Creating event network-changed:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:20:48.846754 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-6ea5a99d-d5a9-4c65-bc5b-9e2e68d78417 req-d0490035-8fa0-48d9-93a7-87fa64518678 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044387 Sep 08 01:20:48.848056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 580/1129] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:48.899794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:48.912081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1f05b4bd-99c7-4e7e-9fdb-4827a3861f62 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.234202 Sep 08 01:20:48.913324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 550/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:48 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:48.985507 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:48.987845 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:48.994122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.995218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.995658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:48.996465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:48.996905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:48.997330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.001228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=100 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:49.027704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b99916fb-e336-4e65-aaa6-a5eacf7cb613 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046550 Sep 08 01:20:49.028292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 581/1131] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:48 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:20:49.148506 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.150817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.156881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:49.158681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.159441 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.160235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.161183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.161843 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.162486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.198814 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c55661b8-8c75-461d-84e4-6157cc6056a5 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054133 Sep 08 01:20:49.199388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 551/1132] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:20:49 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:20:49.265233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.265807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.272142 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.272642 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.273081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.273768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.274220 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.274640 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.301152 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:20:49.376943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-f5730548-eefa-4560-994d-14e4dbe40039 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 204 len: 0 microversion: 2.1 time: 0.115378 Sep 08 01:20:49.377422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 582/1133] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:20:49 2022] DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:20:49.386213 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.386909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.392828 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.393308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.393744 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.394430 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.394880 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.395306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.460202 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.460903 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.468346 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.468841 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.469435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.470332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.470835 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.471195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.532563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:49.540722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-434a1169-5289-447a-a550-4ddbe5426ea8 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1673 microversion: 2.1 time: 0.158710 Sep 08 01:20:49.541391 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 552/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:49 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:49.613918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:49.622257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1447940d-77c0-45a8-9a51-8bbd70bf5b69 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1557 microversion: 2.1 time: 0.166632 Sep 08 01:20:49.624170 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 583/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:49 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:49.645716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.646383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.653362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.653852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.654296 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.654998 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.655455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.655882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.733803 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-98a915eb-77f8-4be0-b42a-5e4bf0b2a5f3 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091965 Sep 08 01:20:49.734784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 553/1136] 10.222.0.42 () {58 vars in 1275 bytes} [Thu Sep 8 01:20:49 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:49.935558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:49.936120 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:49.942049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.942526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.942959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:49.943647 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:49.944099 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:49.944549 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:50.081151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:50.089499 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-92c93560-c22e-43da-abc9-b4b5761ad88a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.158325 Sep 08 01:20:50.090164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 584/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:49 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:50.565857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:50.566460 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:50.573082 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:50.573878 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:50.574313 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:50.574995 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:50.575440 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:50.575857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:50.763418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:50.771069 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dc2d2beb-f1f6-4104-84d5-60e763bcd887 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1673 microversion: 2.1 time: 0.209185 Sep 08 01:20:50.771627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 554/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:50 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:50.868251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4397e20e-3510-4537-a2fd-85cd217071b3", "tag": "5c90b0ad-5d68-4ad9-951d-7ea04741062a"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:50.878837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:50.879391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:50.879893 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:50.891236 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] Creating event network-changed:5c90b0ad-5d68-4ad9-951d-7ea04741062a for instance 4397e20e-3510-4537-a2fd-85cd217071b3 on hv-cinder-84773 Sep 08 01:20:50.896081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-c2b7fac9-19cf-4f6c-ab09-9bc802b55c4c req-ab1ecf73-bf59-4591-91fb-770a5ae93179 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031594 Sep 08 01:20:50.896664 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 585/1139] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:51.113153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:51.113764 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:51.120420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:51.120905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:51.121337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:51.122025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:51.122474 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:51.122904 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:51.258013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:51.266809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9e35af9b-9359-4ee1-9860-c2abeb833cc6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.157354 Sep 08 01:20:51.267587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 555/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:51 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:51.808757 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:51.809675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:51.820059 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:51.820593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:51.821215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:51.821963 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:51.822993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:51.823744 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:51.980595 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:51.988901 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-16294612-70ba-44b1-b28e-7bc685143dce tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1673 microversion: 2.1 time: 0.198174 Sep 08 01:20:51.989838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 586/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:51 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1673 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:52.291174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:52.292614 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:52.300025 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:52.300537 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:52.300967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:52.301903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:52.302356 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:52.302939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:52.622716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:52.631068 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5c4730b6-d365-4ee4-958e-f53b2d9a515d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.344415 Sep 08 01:20:52.632084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 556/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:52 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:20:53.014327 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:53.014950 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:53.021881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.022369 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.022810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.023524 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.023976 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.024440 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.090691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:53.099005 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-855f447f-36e7-4643-8895-2a8f80854448 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1606 microversion: 2.1 time: 0.089223 Sep 08 01:20:53.099697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 587/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:53 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1606 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:53.425160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f46ee2-3552-464f-81dc-f5981ed0b275", "name": "network-vif-deleted", "tag": "9a7efca8-1d75-42a6-9419-1367ce0930d1"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:53.436017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.436514 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.436941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.449013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] Creating event network-vif-deleted:9a7efca8-1d75-42a6-9419-1367ce0930d1 for instance 24f46ee2-3552-464f-81dc-f5981ed0b275 on hv-cinder-84773 Sep 08 01:20:53.455029 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-81bf984f-9a6a-4fd9-81bc-9a6e6d267939 req-8d7f08a5-6d54-4a13-8304-fe756208799b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033129 Sep 08 01:20:53.455935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 557/1144] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:53.654984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:53.655606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:53.661908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.662410 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.663669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.664495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.665028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.665663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.772549 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7941f2c-2db7-48f4-9349-520db58e9b22", "name": "network-vif-plugged", "status": "completed", "tag": "65a31114-bf80-4207-9670-9083d449f4b7"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:53.790689 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:53.793211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:53.799174 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:53.813148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] Creating event network-vif-plugged:65a31114-bf80-4207-9670-9083d449f4b7 for instance d7941f2c-2db7-48f4-9349-520db58e9b22 on hv-cinder-84773 Sep 08 01:20:53.818311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-92fc20b9-1ab0-4446-9e0e-2b99e79a3660 req-3adc7f04-f337-43f9-ba99-8e8b8eb77a0f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051115 Sep 08 01:20:53.819445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 558/1145] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:53.843529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:53.851566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a1cd8844-fb46-44b0-b615-27776c859ef3 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.200554 Sep 08 01:20:53.852160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 588/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:53 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:54.125011 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:54.125885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:54.132659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:54.133704 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:54.134407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:54.135654 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:54.136521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:54.137283 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:54.171706 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:54.172294 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:54.172686 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:54.173131 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lazy-loading 'fault' on Instance uuid 24f46ee2-3552-464f-81dc-f5981ed0b275 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:20:54.217243 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3246a8dea80d4d5b8c3fb50d5f1f31c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c24dd087c274b6094aa720d81b11e98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:54.225545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-16e73309-cf7c-455e-972b-7c28c87cf800 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 200 len: 1328 microversion: 2.1 time: 0.105034 Sep 08 01:20:54.226438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 559/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:54 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 1328 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:54.874899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:54.875461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:54.881910 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:54.882392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:54.882828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:54.883773 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:54.884252 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:54.885193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:55.015765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:55.023360 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-cf5fd76a-33e2-4f8e-b5bc-9ef324427667 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.152444 Sep 08 01:20:55.023927 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 589/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:54 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:55.253118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:55.253725 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:55.260984 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:55.261463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:55.261895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:55.262578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:55.263034 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:55.263457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:55.276578 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 HTTP/1.1 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:20:55.278201 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:55.280045 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '24f46ee2-3552-464f-81dc-f5981ed0b275'} Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:55.284399 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:55.285941 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:55.287661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:55.287661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5f873686-63c3-4cf4-a80c-eca4d244a126 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 404 len: 111 microversion: 2.1 time: 0.030477 Sep 08 01:20:55.287661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 560/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:55 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:20:55.288825 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a0956dac-49b5-4dda-8df7-12cc19c7eeb0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '.version_select at 0x7fe9c9a1bc10>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:55.308948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a0956dac-49b5-4dda-8df7-12cc19c7eeb0 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140455310" status: 202 len: 0 microversion: 2.1 time: 0.024356 Sep 08 01:20:55.309738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 590/1150] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 8 01:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140455310 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:20:56.046223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:56.046831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:56.052742 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:56.053223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:56.053655 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:56.054337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:56.054786 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:56.055223 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:56.192817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:56.201836 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2759555c-63c4-4745-a0b9-5cd8606be548 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1264 microversion: 2.1 time: 0.159561 Sep 08 01:20:56.202405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 561/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:56 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:57.224494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:57.225111 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:57.231855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:57.232369 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:57.232815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:57.233514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:57.234047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:57.234517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:57.370276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:57.377905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3aa1df67-b4e0-4140-925d-85f586eed443 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1451 microversion: 2.1 time: 0.157559 Sep 08 01:20:57.378464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 591/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:57 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:57.401750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:57.402355 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:57.408777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:57.409253 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:57.409741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:57.410663 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:57.411115 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:57.411533 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:57.547308 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:20:57.555032 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b624b236-3fe8-4f77-a9b5-1d944b6712c7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1451 microversion: 2.1 time: 0.157551 Sep 08 01:20:57.555587 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 562/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:57 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:20:58.184851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:58.185349 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:58.191137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:58.191612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:58.192046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:58.192758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:58.193201 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:58.193616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:58.207428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 HTTP/1.1 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:20:58.209160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.210793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '24f46ee2-3552-464f-81dc-f5981ed0b275'} Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:58.211668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.214023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.215631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:58.215631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8d83a1e8-bc1e-4100-ad9b-bd54276f4efd tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 404 len: 111 microversion: 2.1 time: 0.029549 Sep 08 01:20:58.215631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 592/1154] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:20:58 2022] DELETE /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:20:58.219957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:58.220593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 24f46ee2-3552-464f-81dc-f5981ed0b275] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:58.226419 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:58.226898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:58.227362 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:58.228047 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:58.229188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:58.229802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:58.243378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 HTTP/1.1 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:20:58.245388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.247075 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '24f46ee2-3552-464f-81dc-f5981ed0b275'} Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:58.247946 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. Sep 08 01:20:58.249352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:58.250556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 24f46ee2-3552-464f-81dc-f5981ed0b275 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:58.250556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-767112df-cbff-4ed6-96d9-6813d7d73271 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275" status: 404 len: 111 microversion: 2.1 time: 0.031073 Sep 08 01:20:58.250556 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 563/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:58 2022] GET /compute/v2.1/servers/24f46ee2-3552-464f-81dc-f5981ed0b275 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:20:59.141599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7941f2c-2db7-48f4-9349-520db58e9b22", "tag": "65a31114-bf80-4207-9670-9083d449f4b7"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:20:59.151652 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:59.152242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:59.152751 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:59.166593 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] Creating event network-changed:65a31114-bf80-4207-9670-9083d449f4b7 for instance d7941f2c-2db7-48f4-9349-520db58e9b22 on hv-cinder-84773 Sep 08 01:20:59.171898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-1c854399-1550-4d45-8a06-ce75e1cc0ad6 req-40fe5f49-ecaa-499b-941a-41f4aa38fbf1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034124 Sep 08 01:20:59.172918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 593/1156] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:20:59.393093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:59.394145 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:59.401864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:59.402344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:59.402779 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:59.403472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:59.403920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:59.404559 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:59.408950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:20:59.420473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 HTTP/1.1 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:20:59.422317 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.424027 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '57bfe335-f009-4567-b8b1-b1f1fb648d59'} Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:59.425023 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.427493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.429244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:59.429244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2ce37a79-1073-4a4f-8614-3b0fc24fe2e2 tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 404 len: 111 microversion: 2.1 time: 0.035449 Sep 08 01:20:59.429244 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 564/1157] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:20:59 2022] DELETE /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:20:59.434080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:20:59.434790 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] [instance: 57bfe335-f009-4567-b8b1-b1f1fb648d59] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:20:59.441043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:59.441739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:59.442338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:59.443230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:20:59.443681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:20:59.444306 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:20:59.458190 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] HTTP exception thrown: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Request method failure captured: Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 HTTP/1.1 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG_igtvHQTDhbfJAcHA3J3iuNsRN4zzrpTnqt5qH84MreONheH2V8YeYXQEBUS7rxnstTG877Vzc0ZTVu0ZfeV6kshu0rOPveJwpNhQYFqDQjraQdSY9sGB4XmeSc6-syQ9noUxWap6OXkA_9x3nyo1oGIN7QDD-wh3UDTsXD957ek Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:20:59.459838 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8c24dd087c274b6094aa720d81b11e98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8c24dd087c274b6094aa720d81b11e98", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8c24dd087c274b6094aa720d81b11e98"}]}] Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 8c24dd087c274b6094aa720d81b11e98 Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeTestJSON-897700103 Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 3246a8dea80d4d5b8c3fb50d5f1f31c0 Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeTestJSON-897700103-project Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.461486 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '57bfe335-f009-4567-b8b1-b1f1fb648d59'} Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:20:59.462374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. Sep 08 01:20:59.464988 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:20:59.466454 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] Returning 404 to user: Instance 57bfe335-f009-4567-b8b1-b1f1fb648d59 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:20:59.466454 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3e2df2c5-aa0c-4bde-aaed-2c11263010ef tempest-AttachVolumeTestJSON-897700103 tempest-AttachVolumeTestJSON-897700103-project] 10.222.0.42 "GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59" status: 404 len: 111 microversion: 2.1 time: 0.031575 Sep 08 01:20:59.467226 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 594/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:20:59 2022] GET /compute/v2.1/servers/57bfe335-f009-4567-b8b1-b1f1fb648d59 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:03.891932 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-395c9180-71be-49dc-af62-47ec79d27481 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Action: 'create', calling method: .version_select at 0x7fe9c9aa9dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-268597144", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:04.184488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-395c9180-71be-49dc-af62-47ec79d27481 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.406733 Sep 08 01:21:04.185125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 565/1159] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 8 01:21:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 408 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 01:21:04.198756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e7112b00-b020-421b-bf95-ae73e760d191 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9c9ba89d0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:04.252321 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e7112b00-b020-421b-bf95-ae73e760d191 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 200 len: 352 microversion: 2.1 time: 0.057985 Sep 08 01:21:04.252919 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 595/1160] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:04 2022] GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:05.268895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c559bd42-b7df-449f-8e56-1b7a34fffee5 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9cd43aee0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:05.317504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c559bd42-b7df-449f-8e56-1b7a34fffee5 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 200 len: 353 microversion: 2.1 time: 0.052920 Sep 08 01:21:05.318275 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 566/1161] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:05 2022] GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:05.331933 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-341ced48-a6c6-4359-8753-710752026a2f tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9c9c13040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:05.378512 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-341ced48-a6c6-4359-8753-710752026a2f tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 200 len: 353 microversion: 2.1 time: 0.050852 Sep 08 01:21:05.379061 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 596/1162] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:05 2022] GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:21:05.396670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-51ee0267-c7ea-4980-9790-644d1554b9f2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9c9da3b80>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:05.455791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-51ee0267-c7ea-4980-9790-644d1554b9f2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 202 len: 0 microversion: 2.1 time: 0.062819 Sep 08 01:21:05.456395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 567/1163] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:21:05 2022] DELETE /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:21:05.465615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7d9bc7a6-f34c-48cd-b8fb-e584f03330c5 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9c9bc3b80>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:05.518153 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7d9bc7a6-f34c-48cd-b8fb-e584f03330c5 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 200 len: 352 microversion: 2.1 time: 0.057356 Sep 08 01:21:05.518787 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 597/1164] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:05 2022] GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:06.532900 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ed76f547-b412-488e-8791-238d7a8b83b2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Calling method '.version_select at 0x7fe9c9c34700>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:06.560273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-ed76f547-b412-488e-8791-238d7a8b83b2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] HTTP exception thrown: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ed76f547-b412-488e-8791-238d7a8b83b2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Request method failure captured: Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e HTTP/1.1 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUN_Pux_kwCvy_mqRcNSMRaefp_DpD9v9q0p71CwWH4WweJwhidMd8mraIVqCtrmURLpbp0zXu3qUhJPylASNYatI5gFzM_LUVQLkL6YxNOfZEyHIHK8Prxumuya-RybKlQ7lMewpTZ-4jyXdFxyYYs4an0H9zrIUEyfK5j-G0Y6X7U Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 2fb8a6edc25f4d21859b212f7a154771 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesGetTestJSON-270994360 Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:06.573954 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2fb8a6edc25f4d21859b212f7a154771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2fb8a6edc25f4d21859b212f7a154771"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2fb8a6edc25f4d21859b212f7a154771", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2fb8a6edc25f4d21859b212f7a154771"}]}] Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesGetTestJSON-270994360 Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 2fb8a6edc25f4d21859b212f7a154771 Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesGetTestJSON-270994360 Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesGetTestJSON-270994360-project Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: b8be243515cb4aae95e8c24d768e0071 Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesGetTestJSON-270994360-project Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '9e62c2f1-373e-4a96-b643-7a330129972e'} Sep 08 01:21:06.575611 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. (HTTP 404) (Request-ID: req-b82997f6-b7a4-456e-bba8-ccb10d8516ef) Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:06.576627 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:06.578064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 01:21:06.579564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ed76f547-b412-488e-8791-238d7a8b83b2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] Returning 404 to user: Volume 9e62c2f1-373e-4a96-b643-7a330129972e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ed76f547-b412-488e-8791-238d7a8b83b2 tempest-VolumesGetTestJSON-270994360 tempest-VolumesGetTestJSON-270994360-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e" status: 404 len: 109 microversion: 2.1 time: 0.046821 Sep 08 01:21:06.580970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 568/1165] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:06 2022] GET /compute/v2.1/os-volumes/9e62c2f1-373e-4a96-b643-7a330129972e => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:13.585935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:13.587110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:13.591312 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:13.593793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:13.601276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.601745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.602183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.603526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.603992 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.604458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.638258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e27d80a3-4e75-4c4b-936f-b7beca436b74 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053671 Sep 08 01:21:13.638828 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 598/1166] 10.222.0.42 () {60 vars in 1343 bytes} [Thu Sep 8 01:21:13 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:13.703582 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=29 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:13.708195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:13.708912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:13.715977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.716565 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.717001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.717688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.718132 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.718550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.745172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:21:13.823672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a62657df-cd4a-4415-859d-f03b8bcd1a9e tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 204 len: 0 microversion: 2.20 time: 0.123007 Sep 08 01:21:13.824585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 569/1167] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 8 01:21:13 2022] DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 01:21:13.834160 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:13.834758 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:13.842021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.842510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.843011 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.843807 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:13.844288 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:13.844744 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:13.984592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:13.992632 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:13.994620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:13.995800 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1a3814bc-00cf-4c8b-9eb5-d3b9e4142725 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.166137 Sep 08 01:21:13.996422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 599/1168] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:13 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:21:15.023964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:15.025306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:15.031108 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:15.031595 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:15.032030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:15.032747 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:15.033198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:15.033622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:15.165403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:15.173577 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:15.175014 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:15.176206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cd0268b6-8634-4326-a165-5ad1ac9d7cce tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1724 microversion: 2.20 time: 0.157026 Sep 08 01:21:15.176758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 570/1169] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:15 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:21:16.202032 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:16.203887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:16.217257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:16.217879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:16.224677 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:16.225557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:16.226159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:16.226724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:16.302589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:16.312273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:16.313922 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:16.315105 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9ea7368c-ce57-4518-93fa-e8b0547e333d tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1656 microversion: 2.20 time: 0.117363 Sep 08 01:21:16.315667 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 600/1170] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:16 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 01:21:16.492793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "267b508d-389c-4e8b-9812-6b4ec8264b68", "name": "network-vif-deleted", "tag": "19554b5e-764c-4a3a-92c7-65e575d79373"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:16.502964 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:16.503446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:16.503881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:16.515976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] Creating event network-vif-deleted:19554b5e-764c-4a3a-92c7-65e575d79373 for instance 267b508d-389c-4e8b-9812-6b4ec8264b68 on hv-cinder-84773 Sep 08 01:21:16.521361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-2ec06034-f4a8-4223-ac88-170eb99909c5 req-aa067cc1-7168-41fd-9c17-6e30aeed0fa8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Sep 08 01:21:16.521976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 571/1171] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:17.341375 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:17.341977 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:17.348916 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:17.349158 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:17.349589 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:17.350280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:17.350725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:17.351144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:17.385450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:17.385930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:17.386371 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:17.386826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'fault' on Instance uuid 267b508d-389c-4e8b-9812-6b4ec8264b68 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:21:17.432231 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:17.440738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:17.442164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:17.443314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a9d5f48c-81d9-430b-8df3-bf257403f8b4 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1371 microversion: 2.20 time: 0.106056 Sep 08 01:21:17.447753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 601/1172] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:17 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:21:18.469585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:18.470284 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:18.476351 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:18.476829 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:18.477263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:18.477957 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:18.478403 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:18.478822 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:18.510278 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:18.510740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:18.511181 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:18.511613 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'fault' on Instance uuid 267b508d-389c-4e8b-9812-6b4ec8264b68 {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:21:18.557162 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:18.565179 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:18.566630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:18.567785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f4cc17b7-20f8-482a-a3bc-5ed58ac29e27 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1371 microversion: 2.20 time: 0.102969 Sep 08 01:21:18.568392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 572/1173] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:18 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:21:19.593185 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:19.593797 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:19.600283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:19.600706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:19.601144 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:19.601836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:19.602291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:19.602928 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:19.633683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:19.634660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:19.635197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:19.635929 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lazy-loading 'fault' on Instance uuid 267b508d-389c-4e8b-9812-6b4ec8264b68 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:21:19.682191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:19.690156 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:19.691583 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9f2e208a67d4443eb00c75c60c54173f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34623908736a4e3d9f015fc9db90bd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:19.692759 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bd550348-4c77-4a14-a1eb-1d3e3538984b tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 200 len: 1371 microversion: 2.20 time: 0.103551 Sep 08 01:21:19.693313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 602/1174] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:19 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 01:21:20.718484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:20.719198 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:20.727291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:20.727291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:20.727291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:20.727291 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:20.730982 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:20.731432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:20.745280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 HTTP/1.1 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:20.746923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:20.748716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '267b508d-389c-4e8b-9812-6b4ec8264b68'} Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:20.749801 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:20.751384 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:20.753150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:20.753150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7c2e32e3-21af-4f92-8f08-225070e965af tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 404 len: 111 microversion: 2.20 time: 0.033717 Sep 08 01:21:20.753150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 573/1175] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:20 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:21:20.757386 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6baa9e6d-3d45-4ab6-b80b-4b96dc34595a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '.version_select at 0x7fe9c9c138b0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:20.779414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6baa9e6d-3d45-4ab6-b80b-4b96dc34595a tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-522112454" status: 204 len: 0 microversion: 2.20 time: 0.025843 Sep 08 01:21:20.779994 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 603/1176] 10.222.0.42 () {60 vars in 1259 bytes} [Thu Sep 8 01:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-522112454 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 01:21:22.787681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:22.788226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:22.795424 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:22.795895 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:22.796361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:22.797041 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:22.797485 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:22.797903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:22.811285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 HTTP/1.1 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:22.812855 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.814531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '267b508d-389c-4e8b-9812-6b4ec8264b68'} Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:22.815333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.816642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.818289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:22.818289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c49476b0-57bf-4d5f-9969-4de378c32198 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 404 len: 111 microversion: 2.20 time: 0.030458 Sep 08 01:21:22.818289 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 574/1177] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 8 01:21:22 2022] DELETE /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:21:22.822809 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:22.823431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: 267b508d-389c-4e8b-9812-6b4ec8264b68] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:22.830519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:22.831001 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:22.831538 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:22.832258 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:22.832721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:22.833147 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:22.848228 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 HTTP/1.1 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:22.849756 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.851445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '267b508d-389c-4e8b-9812-6b4ec8264b68'} Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:22.852308 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. Sep 08 01:21:22.854332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:22.855732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance 267b508d-389c-4e8b-9812-6b4ec8264b68 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:22.855732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b72393f2-019e-45b2-88c2-6bc8ef1aecea tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68" status: 404 len: 111 microversion: 2.20 time: 0.032306 Sep 08 01:21:22.855732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 604/1178] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:22 2022] GET /compute/v2.1/servers/267b508d-389c-4e8b-9812-6b4ec8264b68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:21:23.992015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:23.992524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:23.999323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:23.999806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:24.000277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:24.000972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:24.001425 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:24.001851 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:24.016105 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 HTTP/1.1 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:24.017703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.019178 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'e5eca3d5-8f1f-4176-bdbd-fd040a0f1707'} Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:24.019930 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.021214 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.022518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:24.022518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2113d5c6-91c1-4276-9241-39194421dc94 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 404 len: 111 microversion: 2.20 time: 0.030918 Sep 08 01:21:24.022518 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 575/1179] 10.222.0.42 () {60 vars in 1280 bytes} [Thu Sep 8 01:21:23 2022] DELETE /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:21:24.028603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:24.029205 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] [instance: e5eca3d5-8f1f-4176-bdbd-fd040a0f1707] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:24.035590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:24.036064 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:24.036636 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:24.037330 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:24.037777 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:24.038198 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:24.051292 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] HTTP exception thrown: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Request method failure captured: Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 HTTP/1.1 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUG5v-9Xapk9nI5LiabJgxBkQwzNw5wWb78vC_V0U50Bg7_-rZ1Ke_jRCCJHBKPgpZ0sZpTCJaKDcJXBqOpXHavXt0b8i6szJTrcbslatgKhecC6GyqxUgrqTkAcfqvANkTsF8d_DlMnLlv4Yi8VDZp8IVqZWVaI4nQXvyzRO6L8pxI Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:24.052834 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/34623908736a4e3d9f015fc9db90bd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_34623908736a4e3d9f015fc9db90bd0d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/34623908736a4e3d9f015fc9db90bd0d"}]}] Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 34623908736a4e3d9f015fc9db90bd0d Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1936115914 Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 9f2e208a67d4443eb00c75c60c54173f Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1936115914-project Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.054607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'e5eca3d5-8f1f-4176-bdbd-fd040a0f1707'} Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:24.055489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. Sep 08 01:21:24.057117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:24.058444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] Returning 404 to user: Instance e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:24.058444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6d95db1b-7319-48c8-b170-cfe451812e05 tempest-AttachVolumeShelveTestJSON-1936115914 tempest-AttachVolumeShelveTestJSON-1936115914-project] 10.222.0.42 "GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707" status: 404 len: 111 microversion: 2.20 time: 0.030043 Sep 08 01:21:24.058444 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 605/1180] 10.222.0.42 () {60 vars in 1277 bytes} [Thu Sep 8 01:21:24 2022] GET /compute/v2.1/servers/e5eca3d5-8f1f-4176-bdbd-fd040a0f1707 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:21:29.019352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6bc32cb5-21f8-4d2d-9769-ea29c3fade58 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Action: 'create', calling method: .version_select at 0x7fe9c9a59ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-468041206"}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:29.367552 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6bc32cb5-21f8-4d2d-9769-ea29c3fade58 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.516201 Sep 08 01:21:29.370238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 576/1181] 10.222.0.42 () {60 vars in 1155 bytes} [Thu Sep 8 01:21:28 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 518 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 01:21:29.382100 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-35d7515e-934e-447a-a2e5-7a2f3b5a8884 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9bc30d0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:29.431840 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-35d7515e-934e-447a-a2e5-7a2f3b5a8884 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 200 len: 344 microversion: 2.1 time: 0.053608 Sep 08 01:21:29.432439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 606/1182] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:29 2022] GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:30.447323 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bf403a87-8967-4a38-9f32-af192a6821c6 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9cd3ccee0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:30.495920 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bf403a87-8967-4a38-9f32-af192a6821c6 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 200 len: 345 microversion: 2.1 time: 0.053305 Sep 08 01:21:30.496521 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 577/1183] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:30 2022] GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:30.510616 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-be306625-6157-4da0-b65c-d7d1b4f35b5a tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Action: 'create', calling method: .version_select at 0x7fe9c9a1baf0>, body: {"snapshot": {"volume_id": "dfc7d7f3-9ec1-4e43-8014-024797de383d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1808241681"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:30.673644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-be306625-6157-4da0-b65c-d7d1b4f35b5a tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.168283 Sep 08 01:21:30.674230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 607/1184] 10.222.0.42 () {60 vars in 1162 bytes} [Thu Sep 8 01:21:30 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:30.685928 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-cd23d6bc-43e1-4fe9-a4d9-c4f27041e653 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9ca99c670>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:30.722608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-cd23d6bc-43e1-4fe9-a4d9-c4f27041e653 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.040451 Sep 08 01:21:30.723165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 578/1185] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:30 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:30.735600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-425e61f2-0b4a-447e-bb99-f20117bd197e tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9a8c040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:30.766888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-425e61f2-0b4a-447e-bb99-f20117bd197e tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036180 Sep 08 01:21:30.767452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 608/1186] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 8 01:21:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:30.779953 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-70b5296c-5791-4b85-abe2-05c8e2217449 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9aa91f0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:30.812694 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-70b5296c-5791-4b85-abe2-05c8e2217449 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.036473 Sep 08 01:21:30.813259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 579/1187] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:30 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:31.825406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-efe7bea1-5442-4d53-8ddd-555737a57dcc tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9c4c040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:31.855046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-efe7bea1-5442-4d53-8ddd-555737a57dcc tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.033999 Sep 08 01:21:31.855582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 609/1188] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:31 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:32.868971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a8cdcb46-0d39-4b0a-a181-0c5ff50409d4 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9a59820>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:32.901019 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a8cdcb46-0d39-4b0a-a181-0c5ff50409d4 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.037046 Sep 08 01:21:32.901586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 580/1189] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:32 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:33.915558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a42553a7-b39b-40ae-9487-25773d53b1ba tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9c12af0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:33.950056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a42553a7-b39b-40ae-9487-25773d53b1ba tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.039765 Sep 08 01:21:33.950684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 610/1190] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:33 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:34.960884 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:34.962101 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:34.966328 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-596941c9-6613-49ff-beb2-f5dd62821aa1 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9aa9c10>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:34.998476 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-596941c9-6613-49ff-beb2-f5dd62821aa1 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.039052 Sep 08 01:21:34.999065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 581/1191] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:34 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:36.007633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:36.009249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=38 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:21:36.014713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1698f38c-60b8-467c-8106-8f162642f3a2 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9ba88b0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:36.045159 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1698f38c-60b8-467c-8106-8f162642f3a2 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.038236 Sep 08 01:21:36.045732 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 611/1192] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:36 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:37.063215 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d97f468a-e1d6-4e1d-8713-497e5d7fc128 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9e2f0d0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:37.103543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d97f468a-e1d6-4e1d-8713-497e5d7fc128 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 288 microversion: 2.1 time: 0.049185 Sep 08 01:21:37.104112 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 582/1193] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:37 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 288 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:37.117213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ccbb1055-e340-4b72-822f-0a309ba50576 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9c12430>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:37.177240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ccbb1055-e340-4b72-822f-0a309ba50576 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 202 len: 0 microversion: 2.1 time: 0.065332 Sep 08 01:21:37.177806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 612/1194] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 8 01:21:37 2022] DELETE /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:21:37.187873 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9b5fcde1-450d-42dd-a461-787c7f620d37 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9a070d0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:37.221701 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9b5fcde1-450d-42dd-a461-787c7f620d37 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.038732 Sep 08 01:21:37.222262 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 583/1195] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:37 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:37.499506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:37.499978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:37.505990 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:37.506467 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:37.506896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:37.507576 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:37.508024 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:37.508745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:37.533726 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a48d6fa0-d509-4c9f-802d-79b1fd95abd5 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/ips" status: 200 len: 148 microversion: 2.1 time: 0.037254 Sep 08 01:21:37.534314 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 613/1196] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:21:37 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:38.235151 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b93e42bb-eb4e-44d6-908a-47bb21e7d5c6 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9e2ff70>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:38.264680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b93e42bb-eb4e-44d6-908a-47bb21e7d5c6 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.033800 Sep 08 01:21:38.265241 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 584/1197] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:38 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:39.277405 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4a175532-926a-499e-bce7-2f06be8d1ef4 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9c12b80>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:39.307810 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4a175532-926a-499e-bce7-2f06be8d1ef4 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 200 len: 287 microversion: 2.1 time: 0.034477 Sep 08 01:21:39.308392 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 614/1198] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:39 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:40.321444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fd542c5c-f0f9-4d69-8c20-1c6b05416242 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9f76430>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:40.346908 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-fd542c5c-f0f9-4d69-8c20-1c6b05416242 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] HTTP exception thrown: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fd542c5c-f0f9-4d69-8c20-1c6b05416242 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Request method failure captured: Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f HTTP/1.1 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUOYCWcAvv82sDhunZwxVV4ZjaAIlBEOnpkMFnXdrp11Ex1VISmyHxAvfVQistof0_lewXw-NvYD6p7hckmMEtsgWgK771V_6SvsWBGs3TlTrwuJM8mA2NnjgAiHDcIul6RvlZRWCZbvK78AfZm88znAeRQzydagUHAzAWa7yxSxML0 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:40.349327 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76e39b45fb864237a4bc22be6fc0aec8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76e39b45fb864237a4bc22be6fc0aec8"}]}] Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: a5ea37cfe6204b2dbd825e702d636b93 Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '89b92f07-b0e2-4036-8369-6dc42222e79f'} Sep 08 01:21:40.351016 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. (HTTP 404) (Request-ID: req-6b25ca9d-cebe-4c03-ae09-f33cbecd6aa0) Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.352635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:40.354852 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 01:21:40.356748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fd542c5c-f0f9-4d69-8c20-1c6b05416242 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Returning 404 to user: Snapshot 89b92f07-b0e2-4036-8369-6dc42222e79f could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:40.358279 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fd542c5c-f0f9-4d69-8c20-1c6b05416242 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f" status: 404 len: 111 microversion: 2.1 time: 0.034242 Sep 08 01:21:40.359401 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 585/1199] 10.222.0.42 () {58 vars in 1251 bytes} [Thu Sep 8 01:21:40 2022] GET /compute/v2.1/os-snapshots/89b92f07-b0e2-4036-8369-6dc42222e79f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:40.365625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07afbdcf-1b49-4849-9d0e-55dff6b10c67 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9c4c700>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:40.426615 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07afbdcf-1b49-4849-9d0e-55dff6b10c67 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 202 len: 0 microversion: 2.1 time: 0.069186 Sep 08 01:21:40.427265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 615/1200] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:21:40 2022] DELETE /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:21:40.436678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-89993972-57e4-4f08-a1d1-86cdd1842d27 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9ddc9d0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:40.484417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-89993972-57e4-4f08-a1d1-86cdd1842d27 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 200 len: 344 microversion: 2.1 time: 0.052115 Sep 08 01:21:40.485060 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 586/1201] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:40 2022] GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:21:40.987658 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1555958-1ffd-4e7d-b424-669f95352fce"}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:40.990509 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:40.996755 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:40.997242 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:40.997753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:40.998397 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:40.998851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:40.999281 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:41.279488 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e8c195e1-449f-4eef-bda4-fda72498bb08 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "POST /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.295618 Sep 08 01:21:41.280117 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 616/1202] 10.222.0.42 () {60 vars in 1323 bytes} [Thu Sep 8 01:21:40 2022] POST /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:41.500052 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8b5585da-7a5c-456b-bb49-35589a86c949 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9cd414af0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:41.637839 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-8b5585da-7a5c-456b-bb49-35589a86c949 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] HTTP exception thrown: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8b5585da-7a5c-456b-bb49-35589a86c949 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Request method failure captured: Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d HTTP/1.1 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUOYCWcAvv82sDhunZwxVV4ZjaAIlBEOnpkMFnXdrp11Ex1VISmyHxAvfVQistof0_lewXw-NvYD6p7hckmMEtsgWgK771V_6SvsWBGs3TlTrwuJM8mA2NnjgAiHDcIul6RvlZRWCZbvK78AfZm88znAeRQzydagUHAzAWa7yxSxML0 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:41.639817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76e39b45fb864237a4bc22be6fc0aec8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76e39b45fb864237a4bc22be6fc0aec8"}]}] Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: a5ea37cfe6204b2dbd825e702d636b93 Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'dfc7d7f3-9ec1-4e43-8014-024797de383d'} Sep 08 01:21:41.641484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. (HTTP 404) (Request-ID: req-077594f2-72db-43c4-bd6e-6fd172e0246c) Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.642447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:41.643830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 01:21:41.645532 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.646925 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.648522 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-8b5585da-7a5c-456b-bb49-35589a86c949 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Returning 404 to user: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:41.649378 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-8b5585da-7a5c-456b-bb49-35589a86c949 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 404 len: 109 microversion: 2.1 time: 0.153597 Sep 08 01:21:41.660197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-24bf6bc7-bd6c-4514-81c6-1684295d74e7 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9c9a43040>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:41.663678 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 587/1203] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:41 2022] GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:41.701935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-24bf6bc7-bd6c-4514-81c6-1684295d74e7 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] HTTP exception thrown: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-24bf6bc7-bd6c-4514-81c6-1684295d74e7 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Request method failure captured: Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d HTTP/1.1 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUOYCWcAvv82sDhunZwxVV4ZjaAIlBEOnpkMFnXdrp11Ex1VISmyHxAvfVQistof0_lewXw-NvYD6p7hckmMEtsgWgK771V_6SvsWBGs3TlTrwuJM8mA2NnjgAiHDcIul6RvlZRWCZbvK78AfZm88znAeRQzydagUHAzAWa7yxSxML0 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:41.705248 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76e39b45fb864237a4bc22be6fc0aec8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76e39b45fb864237a4bc22be6fc0aec8"}]}] Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: a5ea37cfe6204b2dbd825e702d636b93 Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'dfc7d7f3-9ec1-4e43-8014-024797de383d'} Sep 08 01:21:41.706902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. (HTTP 404) (Request-ID: req-3ae7e14f-3428-4c4e-bc48-2ddd1f6663c8) Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.708043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:21:41.709517 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 01:21:41.711210 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-24bf6bc7-bd6c-4514-81c6-1684295d74e7 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Returning 404 to user: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-24bf6bc7-bd6c-4514-81c6-1684295d74e7 tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 404 len: 109 microversion: 2.1 time: 0.051212 Sep 08 01:21:41.712967 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 617/1204] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:21:41 2022] DELETE /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:41.715856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0708142b-f894-43e9-b40b-b5609eb2134d tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Calling method '.version_select at 0x7fe9cd43aee0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:41.746059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-0708142b-f894-43e9-b40b-b5609eb2134d tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] HTTP exception thrown: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0708142b-f894-43e9-b40b-b5609eb2134d tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Request method failure captured: Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d HTTP/1.1 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUOYCWcAvv82sDhunZwxVV4ZjaAIlBEOnpkMFnXdrp11Ex1VISmyHxAvfVQistof0_lewXw-NvYD6p7hckmMEtsgWgK771V_6SvsWBGs3TlTrwuJM8mA2NnjgAiHDcIul6RvlZRWCZbvK78AfZm88znAeRQzydagUHAzAWa7yxSxML0 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:41.748177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/76e39b45fb864237a4bc22be6fc0aec8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_76e39b45fb864237a4bc22be6fc0aec8", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/76e39b45fb864237a4bc22be6fc0aec8"}]}] Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 76e39b45fb864237a4bc22be6fc0aec8 Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-570786679 Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: a5ea37cfe6204b2dbd825e702d636b93 Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesSnapshotsTestJSON-570786679-project Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'dfc7d7f3-9ec1-4e43-8014-024797de383d'} Sep 08 01:21:41.749858 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. (HTTP 404) (Request-ID: req-079d058f-d4ae-4fbb-9d41-e527829ac566) Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.750972 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:21:41.752482 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 01:21:41.753971 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0708142b-f894-43e9-b40b-b5609eb2134d tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] Returning 404 to user: Volume dfc7d7f3-9ec1-4e43-8014-024797de383d could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0708142b-f894-43e9-b40b-b5609eb2134d tempest-VolumesSnapshotsTestJSON-570786679 tempest-VolumesSnapshotsTestJSON-570786679-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d" status: 404 len: 109 microversion: 2.1 time: 0.038224 Sep 08 01:21:41.755410 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 588/1205] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:41 2022] GET /compute/v2.1/os-volumes/dfc7d7f3-9ec1-4e43-8014-024797de383d => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:46.639247 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-bbed3dbf-1dd2-4cc7-8d8f-1f7dade18732 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9cb40d0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:46.689084 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-bbed3dbf-1dd2-4cc7-8d8f-1f7dade18732 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/7a3ec98b-bd54-4172-9207-84d3f9de3729" status: 200 len: 351 microversion: 2.1 time: 0.053412 Sep 08 01:21:46.689657 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 618/1206] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:46 2022] GET /compute/v2.1/os-volumes/7a3ec98b-bd54-4172-9207-84d3f9de3729 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:21:48.027084 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4af55914-d0ac-44d2-ad9e-39be23ea0fb0 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9ddcaf0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:48.075393 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4af55914-d0ac-44d2-ad9e-39be23ea0fb0 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/471bdce5-92dc-45d8-abbe-4f1a293eb3b8" status: 200 len: 350 microversion: 2.1 time: 0.053707 Sep 08 01:21:48.075975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 589/1207] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:48 2022] GET /compute/v2.1/os-volumes/471bdce5-92dc-45d8-abbe-4f1a293eb3b8 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:48.971623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:48.972243 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:48.979294 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:48.979930 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:48.980397 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:48.981110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:48.981562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:48.981985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:49.064586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'services' on Instance uuid 4397e20e-3510-4537-a2fd-85cd217071b3 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:21:49.138961 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-25baf4d1-6bbf-4fa6-9d59-e0e9e2d11ffc tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments/a1555958-1ffd-4e7d-b424-669f95352fce" status: 202 len: 0 microversion: 2.1 time: 0.171514 Sep 08 01:21:49.139624 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 619/1208] 10.222.0.42 () {58 vars in 1416 bytes} [Thu Sep 8 01:21:48 2022] DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments/a1555958-1ffd-4e7d-b424-669f95352fce => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:21:49.149395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.152437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:49.158608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:49.159093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:49.159723 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:49.160459 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:49.160915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:49.161417 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:49.192585 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7a4ea140-71b7-4bda-816a-d9dfe791f99a tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Sep 08 01:21:49.193156 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 590/1209] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:49.439439 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d8dbe152-ff74-43fa-9958-0fd2c6ff6adc tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9c12790>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.485972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d8dbe152-ff74-43fa-9958-0fd2c6ff6adc tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c6814997-ef33-45ea-b2e9-2b267d9d5146" status: 200 len: 351 microversion: 2.1 time: 0.051055 Sep 08 01:21:49.486537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 620/1210] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes/c6814997-ef33-45ea-b2e9-2b267d9d5146 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:49.499404 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-777c82fd-a145-49e6-8102-205dd3f303eb tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9cd43adc0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.579879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-777c82fd-a145-49e6-8102-205dd3f303eb tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084074 Sep 08 01:21:49.580473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 591/1211] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:49.595100 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-11ab1225-8b8a-4a02-8505-76d0847cac2c tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9d76310>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.676489 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-11ab1225-8b8a-4a02-8505-76d0847cac2c tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085077 Sep 08 01:21:49.677057 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 621/1212] 10.222.0.42 () {58 vars in 1149 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:49.691593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-dde13c36-35b3-4630-8cd1-31f57da6b5be tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9a59310>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.773114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-dde13c36-35b3-4630-8cd1-31f57da6b5be tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085222 Sep 08 01:21:49.773743 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 592/1213] 10.222.0.42 () {58 vars in 1134 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:49.787793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-410eaeed-d0e6-45f6-82ca-053243da4884 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9c92700>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.872681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-410eaeed-d0e6-45f6-82ca-053243da4884 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088900 Sep 08 01:21:49.873251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 622/1214] 10.222.0.42 () {58 vars in 1167 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:49.887876 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ff6c05c8-46e4-444d-b497-fe6dff7c6fe4 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9cd3cc700>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:49.978970 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ff6c05c8-46e4-444d-b497-fe6dff7c6fe4 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.095844 Sep 08 01:21:49.980361 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 593/1215] 10.222.0.42 () {58 vars in 1170 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:49.993975 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac3a2bc2-7b78-421f-b03d-2c4c444067a4 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9d76820>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.088859 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac3a2bc2-7b78-421f-b03d-2c4c444067a4 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099338 Sep 08 01:21:50.089782 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 623/1216] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 8 01:21:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:50.103881 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f6059fcf-0319-4430-a68b-7ecfb49904c0 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9a59550>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.190153 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f6059fcf-0319-4430-a68b-7ecfb49904c0 tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090767 Sep 08 01:21:50.199564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 594/1217] 10.222.0.42 () {58 vars in 1188 bytes} [Thu Sep 8 01:21:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:50.205181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d224c597-dbda-483d-82eb-7102809d936f tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] Calling method '.version_select at 0x7fe9c9b70af0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.205394 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.207447 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:50.215079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.215567 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.216001 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.216740 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.217188 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.217608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.250670 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eaa63e4b-4bcd-437b-9f3b-7699469b89e0 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049465 Sep 08 01:21:50.251241 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 595/1218] 10.222.0.42 () {58 vars in 1302 bytes} [Thu Sep 8 01:21:50 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 01:21:50.296391 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d224c597-dbda-483d-82eb-7102809d936f tempest-VolumesTestJSON-545558079 tempest-VolumesTestJSON-545558079-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095144 Sep 08 01:21:50.296965 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 624/1219] 10.222.0.42 () {58 vars in 1155 bytes} [Thu Sep 8 01:21:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:50.330448 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.331235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:50.337837 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.338349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.338791 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.339484 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.339935 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.340383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.374106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:21:50.467333 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-afd0d0c9-7515-4db4-8ee6-73113409da81 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 204 len: 0 microversion: 2.1 time: 0.140302 Sep 08 01:21:50.468007 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 596/1220] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:21:50 2022] DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:21:50.476257 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:50.477053 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:50.484747 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.484909 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.485309 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.486008 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:50.486704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:50.487168 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:50.626660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:50.636785 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-03e9dbb0-46fa-476c-9957-ea98a1dc7e9b tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1681 microversion: 2.1 time: 0.164308 Sep 08 01:21:50.637357 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 625/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:50 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:51.660492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:51.661196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:51.667709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:51.668208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:51.668646 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:51.669339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:51.669787 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:51.670209 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:51.808661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:51.816794 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9a3f1aa6-fa4f-4395-a721-1d888fd3fbb9 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1681 microversion: 2.1 time: 0.160527 Sep 08 01:21:51.817580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 597/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:51 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:52.841584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:52.842193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:52.848715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:52.849191 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:52.849627 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:52.850317 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:52.850765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:52.851214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:52.922907 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:52.931367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c383f81d-2264-4397-b74f-8d71f3855a67 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1613 microversion: 2.1 time: 0.093709 Sep 08 01:21:52.931931 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 626/1223] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:52 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:53.462439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4397e20e-3510-4537-a2fd-85cd217071b3", "name": "network-vif-deleted", "tag": "5c90b0ad-5d68-4ad9-951d-7ea04741062a"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:21:53.480583 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:53.481372 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:53.482009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:53.501048 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] Creating event network-vif-deleted:5c90b0ad-5d68-4ad9-951d-7ea04741062a for instance 4397e20e-3510-4537-a2fd-85cd217071b3 on hv-cinder-84773 Sep 08 01:21:53.507360 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-83ec442c-2c74-436b-9d97-70a571da4722 req-b51c580d-e71b-43d0-89d3-1ccedd2a2bdb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048616 Sep 08 01:21:53.508820 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 598/1224] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:21:53.956548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:53.957320 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:53.967860 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:53.968612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:53.969233 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:53.969942 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:53.970556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:53.971151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:54.022504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:54.023069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:54.023836 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:54.024715 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lazy-loading 'fault' on Instance uuid 4397e20e-3510-4537-a2fd-85cd217071b3 {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:21:54.074568 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83fea9762aaf4766a23f1774ff1411fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e856bb81a717482cbea65029d521700d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:21:54.082526 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0a8fdd7d-0ace-4815-8ff3-cd9c4683b0ce tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 200 len: 1332 microversion: 2.1 time: 0.130092 Sep 08 01:21:54.084194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 627/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:53 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 1332 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:21:55.106835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:55.107662 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:55.114456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:55.114948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:55.115383 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:55.116569 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:55.116697 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:55.117765 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:55.131870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 HTTP/1.1 Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:55.134903 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:55.136702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '4397e20e-3510-4537-a2fd-85cd217071b3'} Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:55.138300 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:55.140576 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:55.142086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:55.142086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-625b8da4-eaf8-44de-a94b-a59e6f8f8201 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 404 len: 111 microversion: 2.1 time: 0.033736 Sep 08 01:21:55.142086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 599/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:55 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:55.147908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-7b924a9b-57a0-452d-88b5-80caee0fffef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '.version_select at 0x7fe9c9c139d0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:55.169192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-7b924a9b-57a0-452d-88b5-80caee0fffef tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720515526" status: 202 len: 0 microversion: 2.1 time: 0.025564 Sep 08 01:21:55.169780 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 628/1227] 10.222.0.42 () {58 vars in 1221 bytes} [Thu Sep 8 01:21:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1720515526 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:21:56.954680 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:56.955197 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:56.963471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:56.963948 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:56.964420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:56.965114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:56.965561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:56.965980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:56.980121 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 HTTP/1.1 Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:56.981688 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:56.983364 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '4397e20e-3510-4537-a2fd-85cd217071b3'} Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:56.987445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:56.988988 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:56.990504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:56.990504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-910e9f3b-8fb9-4bc0-a6a8-d6f5a4917671 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 404 len: 111 microversion: 2.1 time: 0.032325 Sep 08 01:21:56.990504 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 600/1228] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:21:56 2022] DELETE /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:56.993675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:56.994289 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 4397e20e-3510-4537-a2fd-85cd217071b3] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:57.001592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:57.002073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:57.002506 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:57.003195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:57.003826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:57.004286 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:57.018194 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 HTTP/1.1 Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:57.019849 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:57.022414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '4397e20e-3510-4537-a2fd-85cd217071b3'} Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:57.024418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. Sep 08 01:21:57.026661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:57.028407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 4397e20e-3510-4537-a2fd-85cd217071b3 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:57.028407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-1b0149f7-0caa-4389-846f-452de1542860 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3" status: 404 len: 111 microversion: 2.1 time: 0.032429 Sep 08 01:21:57.028407 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 629/1229] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:56 2022] GET /compute/v2.1/servers/4397e20e-3510-4537-a2fd-85cd217071b3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:58.162736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:58.163307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:58.170332 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.170817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.171250 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.171939 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.172412 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.172835 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.186894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 HTTP/1.1 Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:58.188496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.190249 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'e61087ac-46ab-4049-b1db-fed85fa93cf7'} Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:58.191118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.192672 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.194543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:58.194543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-aa4e9830-b22e-40aa-8a32-86d1de66f98e tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 404 len: 111 microversion: 2.1 time: 0.030824 Sep 08 01:21:58.194543 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 601/1230] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:21:58 2022] DELETE /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:58.200551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:58.201176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: e61087ac-46ab-4049-b1db-fed85fa93cf7] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:58.210130 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.210669 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.211370 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.212081 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.212586 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.213014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.227025 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 HTTP/1.1 Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:58.228670 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.230276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'e61087ac-46ab-4049-b1db-fed85fa93cf7'} Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:58.231495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. Sep 08 01:21:58.233045 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.235362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance e61087ac-46ab-4049-b1db-fed85fa93cf7 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:58.235362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b83807de-40e9-47e4-a5d0-006a4e04e5fb tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7" status: 404 len: 111 microversion: 2.1 time: 0.033390 Sep 08 01:21:58.235362 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 630/1231] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:58 2022] GET /compute/v2.1/servers/e61087ac-46ab-4049-b1db-fed85fa93cf7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:58.244342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:58.244342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:58.246161 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.246637 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.247067 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.247748 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.248238 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.248663 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.263335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd HTTP/1.1 Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:58.265081 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.266690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '707afd55-651c-49f6-9e30-7121f95a33dd'} Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:58.270760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.272320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.274195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:58.274195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a75f4480-72a4-481a-ada4-612a9ce5a76d tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 404 len: 111 microversion: 2.1 time: 0.031294 Sep 08 01:21:58.274195 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 602/1232] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:21:58 2022] DELETE /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:58.279445 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:58.280067 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 707afd55-651c-49f6-9e30-7121f95a33dd] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:58.286022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.286504 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.286941 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.287629 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:58.288078 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:58.289080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:58.303684 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd HTTP/1.1 Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:58.305867 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.307502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '707afd55-651c-49f6-9e30-7121f95a33dd'} Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:58.308438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. Sep 08 01:21:58.309668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:58.311042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 707afd55-651c-49f6-9e30-7121f95a33dd could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:58.311042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-782db78d-fa8d-4c00-aaf3-fb1b2b2d0c78 tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd" status: 404 len: 111 microversion: 2.1 time: 0.031665 Sep 08 01:21:58.311042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 631/1233] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:58 2022] GET /compute/v2.1/servers/707afd55-651c-49f6-9e30-7121f95a33dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:59.456702 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:59.457230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:59.464107 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:59.464622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:59.465061 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:59.465754 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:59.466206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:59.466630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:59.481030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e HTTP/1.1 Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:21:59.482590 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.484305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '0def3b08-5561-4931-922e-84d954c7949e'} Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:59.485352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.486882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.488524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:59.488524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-05892f2a-5cfb-4925-b194-cc25d6e751dd tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 404 len: 111 microversion: 2.1 time: 0.031123 Sep 08 01:21:59.488524 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 603/1234] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:21:59 2022] DELETE /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:21:59.495639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:21:59.495639 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] [instance: 0def3b08-5561-4931-922e-84d954c7949e] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:21:59.501184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:59.501738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:59.502187 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:59.502881 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:21:59.503449 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:21:59.503883 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:21:59.518076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] HTTP exception thrown: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Request method failure captured: Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e HTTP/1.1 Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUIZipDBkuEmv2CJCOqQefiifhFDYUvUHo3PXwV2BoXro3b3NR1yhCNzQ4htitf9Pm83q--unZ8j3Gi0BlD_ZIcVHVAibwgRttJIlxGixTDkYsJApdvr_zqTu_3E5cKBgfCP7MJRrwYE8JWsqHBiB4MSM3ZPE07v1_R_Bnbh7tionzA Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:21:59.519551 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e856bb81a717482cbea65029d521700d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e856bb81a717482cbea65029d521700d", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e856bb81a717482cbea65029d521700d"}]}] Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e856bb81a717482cbea65029d521700d Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-875545838 Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 83fea9762aaf4766a23f1774ff1411fe Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-AttachVolumeNegativeTest-875545838-project Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.521363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '0def3b08-5561-4931-922e-84d954c7949e'} Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:21:59.522409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. Sep 08 01:21:59.524334 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:21:59.525487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] Returning 404 to user: Instance 0def3b08-5561-4931-922e-84d954c7949e could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:21:59.525487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2abe7ba5-2c74-4835-9a05-8f03e948f80c tempest-AttachVolumeNegativeTest-875545838 tempest-AttachVolumeNegativeTest-875545838-project] 10.222.0.42 "GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e" status: 404 len: 111 microversion: 2.1 time: 0.031817 Sep 08 01:21:59.525487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 632/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:21:59 2022] GET /compute/v2.1/servers/0def3b08-5561-4931-922e-84d954c7949e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:22:03.761926 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71f2e58a-5e21-456b-b24e-954487857360 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Action: 'create', calling method: .version_select at 0x7fe9c9e2f670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-821858519", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71f2e58a-5e21-456b-b24e-954487857360 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 121 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:22:03.782797 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-821858519", "metadata": {"Type": "work"}}} Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:22:03.784395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-821858519', 'metadata': {'Type': 'work'}}}} Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise error Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.785564 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 01:22:03.787079 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 01:22:03.788891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 01:22:03.788891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.788891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-71f2e58a-5e21-456b-b24e-954487857360 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.788891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-71f2e58a-5e21-456b-b24e-954487857360 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139506 Sep 08 01:22:03.788891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 604/1236] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 8 01:22:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 01:22:03.793956 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15d7d57e-41b9-4b91-aef7-fed88e76ee84 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Action: 'create', calling method: .version_select at 0x7fe9c9cbe280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1341054892", "metadata": {"Type": "work"}}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15d7d57e-41b9-4b91-aef7-fed88e76ee84 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 120 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:22:03.798729 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1341054892", "metadata": {"Type": "work"}}} Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: Sep 08 01:22:03.800376 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1341054892', 'metadata': {'Type': 'work'}}}} Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise error Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi '0' Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.805855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 01:22:03.807493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 01:22:03.808850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 01:22:03.808850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.808850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-15d7d57e-41b9-4b91-aef7-fed88e76ee84 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.808850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-15d7d57e-41b9-4b91-aef7-fed88e76ee84 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009967 Sep 08 01:22:03.808850 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 633/1237] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 8 01:22:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:22:03.810037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f60d1288-de48-47ba-89ee-8a2a100ade03 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Action: 'create', calling method: .version_select at 0x7fe9c99f3700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-718792816", "metadata": {"Type": "work"}}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f60d1288-de48-47ba-89ee-8a2a100ade03 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 118 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:22:03.815042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-718792816", "metadata": {"Type": "work"}}} Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:22:03.816722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-718792816', 'metadata': {'Type': 'work'}}}} Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise error Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi '' Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.822342 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 01:22:03.824885 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 01:22:03.826593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 01:22:03.826593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.826593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f60d1288-de48-47ba-89ee-8a2a100ade03 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.826593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f60d1288-de48-47ba-89ee-8a2a100ade03 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010110 Sep 08 01:22:03.826593 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 605/1238] 10.222.0.42 () {60 vars in 1156 bytes} [Thu Sep 8 01:22:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 01:22:03.827010 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09fd8d00-2bd1-4d83-93a4-77d2184508f1 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Calling method '.version_select at 0x7fe9c9a1b820>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:03.859896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-09fd8d00-2bd1-4d83-93a4-77d2184508f1 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] HTTP exception thrown: Volume tempest-invalid-177593812 could not be found. Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09fd8d00-2bd1-4d83-93a4-77d2184508f1 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-177593812 HTTP/1.1 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:22:03.862413 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Volume tempest-invalid-177593812 could not be found. Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'tempest-invalid-177593812'} Sep 08 01:22:03.864043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-177593812 could not be found. (HTTP 404) (Request-ID: req-0020d973-9f64-4fa7-b9f0-4bb93c54f059) Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.869651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:22:03.871136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-177593812 could not be found. Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:22:03.872388 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-177593812 could not be found. Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-177593812 could not be found. Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-09fd8d00-2bd1-4d83-93a4-77d2184508f1 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 404 to user: Volume tempest-invalid-177593812 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-09fd8d00-2bd1-4d83-93a4-77d2184508f1 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-177593812" status: 404 len: 98 microversion: 2.1 time: 0.041289 Sep 08 01:22:03.873625 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 634/1239] 10.222.0.42 () {58 vars in 1215 bytes} [Thu Sep 8 01:22:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-177593812 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 01:22:03.874539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4b08c277-fd4f-416a-abc7-be8a4c396e36 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003889 Sep 08 01:22:03.879173 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 606/1240] 10.222.0.42 () {58 vars in 1140 bytes} [Thu Sep 8 01:22:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 01:22:03.885031 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6f28cd58-77e6-42f0-b30c-b09ca3413a46 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004580 Sep 08 01:22:03.885590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 635/1241] 10.222.0.42 () {58 vars in 1137 bytes} [Thu Sep 8 01:22:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 08 01:22:03.894395 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-359e2d96-93d4-42fe-9b79-1142f5a9766a tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Calling method '.version_select at 0x7fe9c9e4cd30>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:03.926976 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-359e2d96-93d4-42fe-9b79-1142f5a9766a tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] HTTP exception thrown: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-359e2d96-93d4-42fe-9b79-1142f5a9766a tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/os-volumes/06323907-0402-43b4-8a71-ede6db8f2494 HTTP/1.1 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:22:03.929554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '06323907-0402-43b4-8a71-ede6db8f2494'} Sep 08 01:22:03.931252 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. (HTTP 404) (Request-ID: req-4a06e9d6-a855-45ec-9b74-7b335e7b789c) Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.932413 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 01:22:03.937674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 01:22:03.939120 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-359e2d96-93d4-42fe-9b79-1142f5a9766a tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 404 to user: Volume 06323907-0402-43b4-8a71-ede6db8f2494 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-359e2d96-93d4-42fe-9b79-1142f5a9766a tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/06323907-0402-43b4-8a71-ede6db8f2494" status: 404 len: 109 microversion: 2.1 time: 0.041245 Sep 08 01:22:03.940628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 607/1242] 10.222.0.42 () {58 vars in 1248 bytes} [Thu Sep 8 01:22:03 2022] DELETE /compute/v2.1/os-volumes/06323907-0402-43b4-8a71-ede6db8f2494 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 01:22:03.941937 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c10e3345-e1c8-478c-a84e-c62615108b63 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Calling method '.version_select at 0x7fe9c9bc35e0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:03.975911 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-c10e3345-e1c8-478c-a84e-c62615108b63 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] HTTP exception thrown: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c10e3345-e1c8-478c-a84e-c62615108b63 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Request method failure captured: Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/os-volumes/4c07bfb0-91a9-49db-a9be-19717eca7f98 HTTP/1.1 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUO72TWo9IJLVfmFjFR_2NFGN0-9EkjP2J3lfLPYeCufKjvm8RDPT43PCKGZZB_cNHACYqu-K5Mph48a1hmDOlGh6Cii9Xlq9gzTX5nUf5PLBt0O9Ku4JYscvWTxr_ylk9Qg69mFwlYltjNBu6-LyznJtAuFWba2DjBlkr2jUdle1Rg Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:22:03.977905 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fde2258ae7da4ce6804d78e1e56701f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fde2258ae7da4ce6804d78e1e56701f3", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fde2258ae7da4ce6804d78e1e56701f3"}]}] Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: fde2258ae7da4ce6804d78e1e56701f3 Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-VolumesNegativeTest-458936681 Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: e11b78ec12274a71b8968991aaa7004a Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-VolumesNegativeTest-458936681-project Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '4c07bfb0-91a9-49db-a9be-19717eca7f98'} Sep 08 01:22:03.979644 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. (HTTP 404) (Request-ID: req-ec7a5a03-028e-49bc-8604-78800115d7a2) Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.980769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 01:22:03.982195 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 01:22:03.983651 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c10e3345-e1c8-478c-a84e-c62615108b63 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] Returning 404 to user: Volume 4c07bfb0-91a9-49db-a9be-19717eca7f98 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c10e3345-e1c8-478c-a84e-c62615108b63 tempest-VolumesNegativeTest-458936681 tempest-VolumesNegativeTest-458936681-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/4c07bfb0-91a9-49db-a9be-19717eca7f98" status: 404 len: 109 microversion: 2.1 time: 0.041443 Sep 08 01:22:03.985206 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 636/1243] 10.222.0.42 () {58 vars in 1245 bytes} [Thu Sep 8 01:22:03 2022] GET /compute/v2.1/os-volumes/4c07bfb0-91a9-49db-a9be-19717eca7f98 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:22:49.530260 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:49.531645 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:49.537152 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1974450647", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-979447183", "security_groups": [{"name": "tempest-secgroup-smoke-18365749"}], "block_device_mapping_v2": [{"uuid": "155d998c-e30d-4008-8977-a0815d18955d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5"}]}} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:49.657952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.network.neutron [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] validate_networks() for [('57ae1c2c-a69b-4f5c-b2f3-c0a04c6907c5', None, None, None, None, None)] {{(pid=120716) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 01:22:50.041220 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 01:22:50.041649 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image limits 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 01:22:50.042126 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Flavor pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 01:22:50.042545 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Image pref 0:0:0 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 01:22:50.042959 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.virt.hardware [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120716) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 01:22:50.052265 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:50.052690 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:50.053165 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:50.054046 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:50.054539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:50.054985 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:50.075114 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 01:22:50.080456 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.quota [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Getting quotas for user 744fe07ea5644157bdbf11d81adbab89 and project 4221b10efb3d4bb799d820e985a48651. Resources: {'ram', 'cores', 'instances'} {{(pid=120716) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 01:22:50.140867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Going to run 1 instances... {{(pid=120716) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 01:22:50.142875 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='155d998c-e30d-4008-8977-a0815d18955d',volume_size=None,volume_type=None)] {{(pid=120716) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 01:22:50.295739 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [4944adea-4d61-4a71-a73e-a2bd06032df1] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 01:22:51.305227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [4944adea-4d61-4a71-a73e-a2bd06032df1] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 45464. Sep 08 01:22:51.309428 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-f9f44ec0-d27d-4724-bd41-1e24b5b403a6 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.780891 Sep 08 01:22:51.310240 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 608/1244] 10.222.0.42 () {60 vars in 1147 bytes} [Thu Sep 8 01:22:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 01:22:51.322457 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eaa40d14-42ad-41e3-b766-8632278e0339 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:51.323804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eaa40d14-42ad-41e3-b766-8632278e0339 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:51.326924 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:51.327683 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:22:51.386238 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eaa40d14-42ad-41e3-b766-8632278e0339 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:51.393498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eaa40d14-42ad-41e3-b766-8632278e0339 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1094 microversion: 2.1 time: 0.075227 Sep 08 01:22:51.394056 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 637/1245] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:51 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:52.417776 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0f6820d7-4cba-44f5-adb4-ad56f210548e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:52.419105 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0f6820d7-4cba-44f5-adb4-ad56f210548e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:52.477722 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0f6820d7-4cba-44f5-adb4-ad56f210548e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:52.485353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0f6820d7-4cba-44f5-adb4-ad56f210548e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1094 microversion: 2.1 time: 0.072331 Sep 08 01:22:52.485916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 609/1246] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:52 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:53.513534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-2ef827d2-48c3-4b31-9823-7ac6edea8cc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:53.513534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-2ef827d2-48c3-4b31-9823-7ac6edea8cc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:53.573269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-2ef827d2-48c3-4b31-9823-7ac6edea8cc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:53.580863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-2ef827d2-48c3-4b31-9823-7ac6edea8cc7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1094 microversion: 2.1 time: 0.076189 Sep 08 01:22:53.581428 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 638/1247] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:53 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:54.604305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6f2e3915-84a4-4d53-b5ec-9da2d98fdf71 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:54.604929 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6f2e3915-84a4-4d53-b5ec-9da2d98fdf71 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:54.663909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6f2e3915-84a4-4d53-b5ec-9da2d98fdf71 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:54.670919 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6f2e3915-84a4-4d53-b5ec-9da2d98fdf71 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1094 microversion: 2.1 time: 0.070515 Sep 08 01:22:54.672193 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 610/1248] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:54 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:55.693935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:55.694557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:55.701863 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:55.702184 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:55.703155 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:55.703862 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:55.704344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:55.704771 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:55.773151 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:55.781273 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8ae9781a-e8ec-44eb-a6f0-02dba87b256a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1144 microversion: 2.1 time: 0.090768 Sep 08 01:22:55.781857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 639/1249] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:55 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:56.803894 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:56.804622 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:56.813653 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:56.814146 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:56.814806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:56.815473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:56.815933 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:56.816407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:56.927882 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:56.937655 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2daeb637-c4ff-4c75-a6df-040bad05c3ff tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1210 microversion: 2.1 time: 0.137625 Sep 08 01:22:56.938529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 611/1250] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:56 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:57.492982 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:57.493612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:57.501367 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.501864 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.502300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:57.503018 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.503470 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.503896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:57.529818 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.objects.instance [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lazy-loading 'flavor' on Instance uuid 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea {{(pid=120715) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:22:57.612721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-a96c4a79-df86-41fc-b6d9-3fc05647820c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "POST /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea/action" status: 202 len: 0 microversion: 2.1 time: 0.123389 Sep 08 01:22:57.613972 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 640/1251] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:22:57 2022] POST /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:22:57.623336 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:57.623952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:57.638696 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.639098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.639539 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:57.640891 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.641363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.641773 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:57.888566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:57.899411 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-79c969cf-588a-4b20-8b85-7309cb70c3c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.279850 Sep 08 01:22:57.900511 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 612/1252] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:57 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:57.963408 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:57.964474 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:57.972021 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.972564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.973002 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:57.973706 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:57.974139 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:57.974557 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:58.120692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:58.131698 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-640efce4-caa0-46cf-8169-604db805656f tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.173620 Sep 08 01:22:58.132406 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 641/1253] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:57 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:58.282339 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de12c6f0-dbcb-420c-9f16-143ee9c9d17a", "tag": "01e62ce5-f4b1-4017-b879-1bd62d631c51"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:22:58.295217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:58.295487 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:58.296730 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:58.320015 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] Creating event network-changed:01e62ce5-f4b1-4017-b879-1bd62d631c51 for instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a on hv-cinder-84773 Sep 08 01:22:58.327059 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-882570c5-a269-4b56-b260-0bee1451830d req-5bc21e13-b11c-4a61-b0ca-e9504c219099 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056610 Sep 08 01:22:58.332483 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 613/1254] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:22:58.924042 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:58.924746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:58.931115 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:58.931594 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:58.932450 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:58.932748 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:58.933197 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:58.933620 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:59.125484 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:59.133618 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-28ae5b22-c2bc-484c-97a1-9c926b5fafd7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.214097 Sep 08 01:22:59.134203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 642/1255] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:58 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:22:59.161909 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:22:59.162621 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:22:59.169229 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:59.169734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:59.170235 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:59.171815 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:22:59.172652 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:22:59.173359 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:22:59.404502 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:22:59.413792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-1f1aa4c0-9903-4dd3-a80e-89275a5b633e tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.256871 Sep 08 01:22:59.414683 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 614/1256] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:22:59 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:00.159049 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:00.159806 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:00.166435 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:00.167097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:00.167635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:00.168441 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:00.169138 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:00.169521 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:00.319076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:00.326861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e0d5bbdd-ea95-4d84-a469-60b3ef21fffa tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.171911 Sep 08 01:23:00.328359 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 643/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:00 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:00.438237 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:00.439472 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:00.441656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=2 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:00.447602 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:00.448086 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:00.448561 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:00.449260 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:00.449716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:00.450205 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:00.605736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:00.614618 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-6fc10328-1ab1-4bd0-85b9-00452a44a824 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.180859 Sep 08 01:23:00.615194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 615/1258] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:00 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:01.350592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:01.351187 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:01.358161 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:01.358648 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:01.359363 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:01.360269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:01.360728 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:01.361154 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:01.501390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:01.509383 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-07c90bc7-606e-4fb2-8c8d-439b0b1d4226 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.162687 Sep 08 01:23:01.509944 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 644/1259] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:01 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:01.639030 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:01.639642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:01.646334 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:01.646800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:01.647231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:01.647907 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:01.648382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:01.648800 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:01.783257 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:01.790856 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-bed216a2-1764-4615-9b31-d815e3de0068 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.155660 Sep 08 01:23:01.791419 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 616/1260] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:01 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:02.534203 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:02.534896 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:02.541122 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:02.541668 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:02.542106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:02.542792 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:02.543244 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:02.543663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:02.676279 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:02.683914 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-eb729c9a-d1ed-4673-b0e8-aedc745468b4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.154199 Sep 08 01:23:02.684502 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 645/1261] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:02 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:02.814659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:02.815203 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:02.821531 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:02.822000 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:02.822432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:02.823109 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:02.823554 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:02.823973 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:02.960341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:02.967854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5e2b884e-4328-4ba6-847f-7d5ea76c7a17 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.157826 Sep 08 01:23:02.968709 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 617/1262] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:02 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:03.707815 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:03.708453 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:03.710879 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell0:SELECT=4 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:03.716313 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:03.716736 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:03.717173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:03.717933 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:03.718390 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:03.718826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:03.852821 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:03.861032 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b7fda2a1-1f28-4adb-bc56-754303f1f9c5 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.157121 Sep 08 01:23:03.861600 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 646/1263] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:03 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:03.990923 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:03.991481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:03.997783 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:03.998256 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:03.998681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:03.999902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:04.000373 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:04.000793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:04.144540 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:04.154122 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-d46d379b-bc68-4cbd-8408-185e07ff2fe9 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.167202 Sep 08 01:23:04.154715 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 618/1264] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:03 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:04.884886 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:04.885490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:04.893019 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:04.893485 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:04.893918 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:04.894599 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:04.895046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:04.895465 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:05.032997 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:05.041325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c7ab0942-151e-4a1f-86b8-edce5bdfd92b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.160562 Sep 08 01:23:05.041885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 647/1265] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:04 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:23:05.179261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:05.180270 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:05.183760 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell0:SELECT=10 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:05.189830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:05.190311 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:05.190738 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:05.191423 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:05.191869 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:05.192312 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:05.325226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:05.332809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-3a1d765d-eb00-4684-9c5d-c512b705a4db tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.158701 Sep 08 01:23:05.333369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 619/1266] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:05 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:06.064968 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:06.065574 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:06.071943 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:06.072442 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:06.072876 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:06.073556 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:06.073999 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:06.074415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:06.208215 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:06.216414 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-8eaf3165-f7f9-4de0-8ad1-605e55be4afb tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.155534 Sep 08 01:23:06.216989 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 648/1267] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:06 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:06.355160 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:06.355720 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:06.362210 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:06.362692 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:06.363123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:06.363814 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:06.364288 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:06.364714 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:06.493304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:06.501128 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9bbf3e69-de1c-40b7-9ac9-eca58956e465 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.150033 Sep 08 01:23:06.501686 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 620/1268] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:06 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:07.239455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:07.240069 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:07.246725 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:07.247209 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:07.247635 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:07.248355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:07.248804 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:07.249226 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:07.384548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:07.392899 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-974c70b2-a8cd-4015-bf1b-5413719a5721 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.157355 Sep 08 01:23:07.393490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 649/1269] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:07 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:07.523952 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:07.524588 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:07.530967 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:07.531445 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:07.532171 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:07.532898 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:07.533377 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:07.533918 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:07.677259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:07.684770 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-272fd2fd-8fbd-4a05-88da-6ede996d609d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.164664 Sep 08 01:23:07.685915 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 621/1270] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:07 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:08.415939 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:08.416587 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:08.423681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:08.424188 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:08.424631 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:08.425336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:08.425789 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:08.426218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:08.559993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:08.568265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-3a9373a5-5be4-4372-8a8e-29b9f0a27b7e tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.156176 Sep 08 01:23:08.568827 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 650/1271] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:08 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:08.709477 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:08.710088 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:08.716535 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:08.717013 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:08.717446 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:08.718130 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:08.718581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:08.719008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:08.848945 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:08.856550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a196cac3-d545-47de-ae96-3da4250ffcaf tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.150918 Sep 08 01:23:08.857297 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 622/1272] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:08 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:09.066750 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de12c6f0-dbcb-420c-9f16-143ee9c9d17a", "name": "network-vif-plugged", "status": "completed", "tag": "01e62ce5-f4b1-4017-b879-1bd62d631c51"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:23:09.076993 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:09.077494 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:09.077915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:09.089626 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] Creating event network-vif-plugged:01e62ce5-f4b1-4017-b879-1bd62d631c51 for instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a on hv-cinder-84773 Sep 08 01:23:09.094885 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-a6f6fac3-d00a-4505-8dd9-35a34129848e req-83f01711-f41d-4572-967b-87bd6263b9d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032717 Sep 08 01:23:09.095476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 651/1273] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:23:09.591600 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:09.592259 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:09.599003 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:09.599473 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:09.599897 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:09.600599 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:09.601042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:09.601457 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:09.736085 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:09.743726 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-976c1368-715c-4ef4-a03d-5cd7433b4eb7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.155972 Sep 08 01:23:09.744318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 623/1274] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:09 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:09.880269 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:09.880969 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:09.887529 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:09.888014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:09.888473 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:09.889169 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:09.889623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:09.890047 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:10.031001 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:10.046320 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-78e15dad-61ec-4012-9fe5-506dcd0c7f28 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.171022 Sep 08 01:23:10.052542 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 652/1275] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:09 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:10.767758 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:10.768408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:10.774890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:10.775369 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:10.775804 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:10.776527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:10.776979 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:10.777407 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:10.906757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:10.914481 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7976e52a-a1c3-4ad5-85d8-dabe16920af3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.151574 Sep 08 01:23:10.914974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 624/1276] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:10 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:11.070224 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:11.070829 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:11.076823 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:11.077297 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:11.077730 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:11.079555 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:11.080012 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:11.080464 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:11.217724 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:11.225592 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-5b54c31d-6c58-454f-ba99-b8615ade8be8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1264 microversion: 2.1 time: 0.159183 Sep 08 01:23:11.226165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 653/1277] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:11 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:11.938330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:11.939037 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:11.948741 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:11.949437 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:11.949870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:11.950568 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:11.951022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:11.951439 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.100581 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:12.108432 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-7ef5ba0f-66da-4b8d-8f52-4f95f54bf628 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1568 microversion: 2.1 time: 0.174621 Sep 08 01:23:12.108989 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 625/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:11 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:12.130251 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:23:12.130855 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:12.137793 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.138280 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.138723 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.139415 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.139873 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.140338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.144602 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:12.170880 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120715) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 01:23:12.235260 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-76e1c307-e171-4f59-9794-99b054fbd120 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "POST /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea/action" status: 202 len: 0 microversion: 2.1 time: 0.108728 Sep 08 01:23:12.235897 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 654/1279] 10.222.0.42 () {60 vars in 1278 bytes} [Thu Sep 8 01:23:12 2022] POST /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 01:23:12.244150 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:12.244772 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:12.247923 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:12.248566 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:12.251388 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.251975 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.252464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.253183 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.253817 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.254255 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.255114 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.255606 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.256046 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.256774 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.257230 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.257660 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.421674 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:12.427767 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:12.431735 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-4743269e-96c2-47c3-92fa-6bcf1ab67648 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1576 microversion: 2.1 time: 0.191525 Sep 08 01:23:12.436208 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 626/1280] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:12 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1576 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:12.439448 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-562dd79a-910b-4c3d-ba4b-c7d5025a5355 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1452 microversion: 2.1 time: 0.195159 Sep 08 01:23:12.440091 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 655/1281] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:12 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:23:12.462492 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:12.463119 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:12.469306 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.469987 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.470420 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.471111 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:12.471560 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:12.471983 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:12.614550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:12.618826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=100 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:12.623902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-eceb6b7d-e489-49d4-b681-80b47ed7e0e1 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1452 microversion: 2.1 time: 0.165221 Sep 08 01:23:12.624711 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 627/1282] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:12 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:13.456250 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:13.456857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:13.463133 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:13.463603 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:13.464030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:13.464735 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:13.465183 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:13.465604 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:13.673125 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:13.680907 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0301cd86-85e7-49bc-9933-b04382466346 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1516 microversion: 2.1 time: 0.229370 Sep 08 01:23:13.681490 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 656/1283] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:13 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:14.345550 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de12c6f0-dbcb-420c-9f16-143ee9c9d17a", "tag": "01e62ce5-f4b1-4017-b879-1bd62d631c51"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:23:14.355969 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:14.356480 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:14.356911 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:14.369010 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] Creating event network-changed:01e62ce5-f4b1-4017-b879-1bd62d631c51 for instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a on hv-cinder-84773 Sep 08 01:23:14.374053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-c4faed47-5cb9-4223-8382-fe1518a19c6b req-d3e6ed45-f1f9-4800-a907-dfdb82209499 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032575 Sep 08 01:23:14.374651 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 628/1284] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:23:14.706022 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:14.706623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:14.713176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:14.713661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:14.714098 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:14.715036 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:14.715495 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:14.715925 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:14.871638 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:14.881088 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6ee4bfd3-bdfa-4e48-a16c-e5bfcb837426 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1516 microversion: 2.1 time: 0.179565 Sep 08 01:23:14.885908 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 657/1285] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:14 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:15.065227 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "name": "network-vif-unplugged", "status": "completed", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:23:15.083018 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:15.084098 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:15.084980 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:15.101756 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.compute.server_external_events [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] Unable to find a host for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea. Dropping event network-vif-unplugged {{(pid=120716) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 01:23:15.102793 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-94206d40-8848-438c-ab87-7376f0f19c9f req-5560e53b-6c01-4983-8118-bdfcae6de643 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043080 Sep 08 01:23:15.103896 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 629/1286] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 45 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 01:23:15.906571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:15.907291 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:15.915176 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:15.915769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:15.916319 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:15.917283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:15.917901 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:15.918511 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:16.074471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:16.083978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-4e869413-a5cc-49df-890c-9d786aa2dde9 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1518 microversion: 2.1 time: 0.181539 Sep 08 01:23:16.084650 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 658/1287] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:15 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1518 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:17.108076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:17.109123 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:17.116853 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:17.117344 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:17.117784 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:17.118489 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:17.118974 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:17.119408 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:17.338541 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:17.346656 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-c79b012e-8fce-4c71-9b47-c1ae79584c51 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.242343 Sep 08 01:23:17.347144 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 630/1288] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:17 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:18.370675 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:18.371259 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:18.377959 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:18.378438 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:18.378861 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:18.379535 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:18.379977 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:18.380433 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:18.508437 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:18.516192 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d21c55fe-cc1e-4414-b93b-f165ac185c6c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.149401 Sep 08 01:23:18.516765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 659/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:18 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:19.539402 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:19.540008 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:19.546065 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:19.547053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:19.547488 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:19.548189 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:19.548635 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:19.549055 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:19.677113 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:19.684840 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-39c0e84f-f110-4638-b8da-77fc951a432c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.149300 Sep 08 01:23:19.685418 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 631/1290] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:19 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:20.709344 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:20.709888 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:20.716409 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:20.716889 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:20.717325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:20.718014 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:20.718548 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:20.718985 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:20.849381 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:20.857097 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-56e706ee-52a0-4571-a7f3-7ed2c3b6fca6 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.151749 Sep 08 01:23:20.857665 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 660/1291] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:20 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:21.879703 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:21.880343 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:21.882864 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:21.888574 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:21.889053 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:21.889486 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:21.890177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:21.890630 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:21.891054 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:22.027318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:22.035848 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fbee1bdf-2351-4162-a3e8-a67091bd3c59 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.160595 Sep 08 01:23:22.036455 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 632/1292] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:21 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:23.059325 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:23.059936 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:23.062395 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:23:23.068978 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:23.069461 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:23.069892 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:23.070579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:23.071030 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:23.071452 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:23.202534 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:23.210701 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ac630472-0b6d-4a54-a077-4784efb5324b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.155328 Sep 08 01:23:23.211265 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 661/1293] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:23 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:24.233757 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:24.234352 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:24.240842 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:24.241318 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:24.241749 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:24.242431 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:24.242879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:24.243299 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:24.373230 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:24.381507 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-98b96605-e8cc-4c9c-9757-c04fce1dcc4b tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.151761 Sep 08 01:23:24.382066 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 633/1294] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:24 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:25.405564 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:25.406173 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:25.412745 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:25.413227 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:25.413663 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:25.414355 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:25.414900 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:25.415336 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:25.548523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:25.557157 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-ec6b1b62-a85f-48f8-be3c-56fde8b50e15 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.155689 Sep 08 01:23:25.557738 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 662/1295] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:25 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:26.580716 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:26.581392 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:26.587777 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:26.588335 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:26.588771 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:26.589463 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:26.589916 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:26.590341 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:26.725830 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:26.733634 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0ca86e62-bff7-4116-a05d-7afb784a3367 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.156958 Sep 08 01:23:26.734211 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 634/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:26 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:27.223141 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "name": "network-vif-plugged", "status": "completed", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:23:27.233694 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:27.234165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:27.234584 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:27.246082 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] Creating event network-vif-plugged:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:23:27.251128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-e4cb1d08-3411-4f05-9b57-b596478b925b req-7d4a0949-9e2e-4221-90a1-7882539a8ed1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032623 Sep 08 01:23:27.252332 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 663/1297] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:23:27.757558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:27.758438 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:27.764862 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:27.765337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:27.765767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:27.766453 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:27.766899 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:27.767320 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:27.899148 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:27.906775 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-91723971-1016-43f6-97a0-a82dbe46d1c0 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.153052 Sep 08 01:23:27.907337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 635/1298] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:27 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:28.930926 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:28.931628 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:28.937801 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:28.938283 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:28.938721 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:28.939948 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:28.940475 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:28.940901 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:29.076323 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:29.084561 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-766d7053-cd26-4d8b-8728-ece30bc1c04d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1574 microversion: 2.1 time: 0.158333 Sep 08 01:23:29.085128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 664/1299] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:28 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:23:30.107125 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:23:30.107728 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:23:30.114140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:30.114609 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:30.115035 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:30.115707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:23:30.116226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:23:30.116586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:23:30.244767 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:23:30.253091 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-a371f322-34ec-4745-a37e-ee37b69428e4 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1561 microversion: 2.1 time: 0.149601 Sep 08 01:23:30.253675 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 636/1300] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:23:30 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1561 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:49.716955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 01:24:49.717497 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Thu Sep 8 01:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea (ip 10.222.0.42) !!! Sep 08 01:24:49.718887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_api:SELECT=7 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:49.718887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG dbcounter [-] [120715] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120715) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:49.722802 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 01:24:49.723263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Thu Sep 8 01:24:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 08 01:24:49.724814 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:49.725009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_api:SELECT=9 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:49.725136 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:49.725707 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG dbcounter [-] [120716] Writing DB stats nova_cell1:SELECT=46 {{(pid=120716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 01:24:49.742981 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:49.743467 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:49.743902 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:49.744661 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:49.746418 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:49.746857 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:49.776164 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:24:49.861089 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-c4de3489-3f1e-4f0a-858b-81293c51789a tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 204 len: 0 microversion: 2.1 time: 0.146377 Sep 08 01:24:49.862076 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 665/1301] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:24:49 2022] DELETE /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:24:49.871515 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:24:49.874770 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:49.875882 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:49.882705 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:49.882902 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:49.883458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:49.883641 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:49.883887 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:49.884024 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:49.884611 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:49.885050 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:49.885468 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:49.897671 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] Creating event network-changed:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:24:49.903509 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-599938b4-7e26-4fee-b963-37f1c953252f req-1fc56a87-fb88-4d18-a930-0de31093e553 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187029 Sep 08 01:24:49.904529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 637/1302] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:24:50.180582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:50.188401 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-6c9b3d27-aecb-426f-ab9e-8d1ed5e25e05 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.320055 Sep 08 01:24:50.188979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 666/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:49 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:51.110604 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:51.111204 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:51.118217 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.118734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.119172 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.119861 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.120382 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.120809 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.146544 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Going to try to terminate instance {{(pid=120716) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:24:51.212826 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:51.213422 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:51.221023 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.221498 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.222137 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.223182 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.224458 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.224891 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.234130 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-5ec1faf6-22ad-470d-980b-85fd70c3d1d7 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 204 len: 0 microversion: 2.1 time: 0.128005 Sep 08 01:24:51.234781 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 638/1304] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:24:51 2022] DELETE /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:24:51.244363 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:51.245893 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:51.252330 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.253078 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.253857 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.254940 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.255889 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.256566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.381382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:51.390455 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-9419a1fd-5ed0-4eb1-bdfe-f5949f1358d3 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.182497 Sep 08 01:24:51.391043 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 667/1305] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:51 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:51.475374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:51.483268 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-b449eb62-fe12-42b5-bd71-5f380553f2b8 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1577 microversion: 2.1 time: 0.243465 Sep 08 01:24:51.483833 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 639/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:51 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1577 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:24:51.917858 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de12c6f0-dbcb-420c-9f16-143ee9c9d17a", "tag": "01e62ce5-f4b1-4017-b879-1bd62d631c51"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:24:51.928264 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:51.928739 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:51.929165 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:51.940426 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] Creating event network-changed:01e62ce5-f4b1-4017-b879-1bd62d631c51 for instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a on hv-cinder-84773 Sep 08 01:24:51.946523 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-9a0d8121-117f-4b0e-9ec6-ab604228e1e9 req-b2c069ac-cf85-4cc6-9b12-090324216ac1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 Sep 08 01:24:51.947128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 668/1307] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:24:52.415370 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:52.415936 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:52.422190 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:52.422659 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:52.423118 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:52.423792 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:52.424263 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:52.424681 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:52.508808 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:52.509514 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:52.515590 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:52.516075 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:52.516540 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:52.517229 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:52.517681 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:52.518106 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:52.557307 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:52.565309 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-51c48357-4bae-429c-a0d0-8b50a3b7da6d tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.154507 Sep 08 01:24:52.565879 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 640/1308] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:52 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:52.652487 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:52.660181 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-0b1a89dc-fe65-4392-a48c-238ceaf41c18 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1577 microversion: 2.1 time: 0.156255 Sep 08 01:24:52.660915 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 669/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:52 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:24:53.589058 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:53.589751 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:53.596847 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:53.597324 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:53.597750 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:53.599049 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:53.599496 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:53.599912 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:53.683837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:53.684851 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:53.692666 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:53.693225 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:53.693870 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:53.695130 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:53.695711 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:53.696516 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:53.871206 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:53.879374 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-e56f7344-a323-4595-955e-c33ce67f216c tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1567 microversion: 2.1 time: 0.294098 Sep 08 01:24:53.880826 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 641/1310] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:53 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:54.033731 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:54.043768 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-69afdac8-bc3b-4965-bad9-5b0ba786922d tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1577 microversion: 2.1 time: 0.363728 Sep 08 01:24:54.052673 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 670/1311] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:53 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1577 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 01:24:54.409106 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea", "name": "network-vif-deleted", "tag": "13ca534f-47d6-4dc3-92b4-c1973abbb30f"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:24:54.420778 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:54.421196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:54.421890 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:54.433226 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] Creating event network-vif-deleted:13ca534f-47d6-4dc3-92b4-c1973abbb30f for instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea on hv-cinder-84773 Sep 08 01:24:54.438510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-29ebf64e-a8c2-489f-b48d-d992e6cfd02d req-f651a625-4ac2-480a-81ae-7351457c4106 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 Sep 08 01:24:54.439276 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 642/1312] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:24:54.904817 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:54.905427 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:54.911932 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:54.912434 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:54.912890 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:54.913571 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:54.914016 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:54.914431 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:54.981028 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00917dba4a9f4d56be3ec74f90a65154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e32dd1d6dcf54fbb83667953c4cbea29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:54.989691 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-12c3d00c-9f40-4db9-8b8f-603b889b63e7 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 200 len: 1219 microversion: 2.1 time: 0.088198 Sep 08 01:24:54.990338 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 671/1313] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:54 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:55.069140 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:55.069846 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:55.076017 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:55.076523 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:55.076950 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:55.077632 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:55.078076 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:55.078499 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:55.110831 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:55.111305 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:55.111734 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:55.112194 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.objects.instance [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lazy-loading 'fault' on Instance uuid de12c6f0-dbcb-420c-9f16-143ee9c9d17a {{(pid=120716) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 01:24:55.155493 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:24:55.163516 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ace5e586-b350-424e-a447-faee7b090621 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 200 len: 1230 microversion: 2.1 time: 0.100162 Sep 08 01:24:55.164379 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 643/1314] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:55 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:24:56.014178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:56.014786 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] [instance: 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:56.021704 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:56.022187 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:56.022623 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:56.023311 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:56.023760 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:56.024204 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:56.038429 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] HTTP exception thrown: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Request method failure captured: Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea HTTP/1.1 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUMtVlwNZIzvVjrLft_RlQMth8lOMERExnwfD3QyEvUkbQg_Vr9ukIYRbRvPKqie_Jm6r_ZRYa73d1dhL1skOrzfyRc7HP-g0Mh1SrmuMtVhcpMxS7FT4eoIx1xoRtJfILrw-J08-HBb494pIrUGz-J-0kyCennT32t68n4hxjyObBo Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: e32dd1d6dcf54fbb83667953c4cbea29 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestShelveInstance-589586563 Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:24:56.040073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e32dd1d6dcf54fbb83667953c4cbea29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e32dd1d6dcf54fbb83667953c4cbea29"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e32dd1d6dcf54fbb83667953c4cbea29", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e32dd1d6dcf54fbb83667953c4cbea29"}]}] Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestShelveInstance-589586563 Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: e32dd1d6dcf54fbb83667953c4cbea29 Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestShelveInstance-589586563 Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-TestShelveInstance-589586563-project Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 00917dba4a9f4d56be3ec74f90a65154 Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestShelveInstance-589586563-project Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. Sep 08 01:24:56.041869 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea'} Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:24:56.043271 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. Sep 08 01:24:56.044813 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.047249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Returning 404 to user: Instance 4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:24:56.047249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-e2bfc91b-af65-49f7-bd40-eee96aa11f80 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea" status: 404 len: 111 microversion: 2.1 time: 0.031306 Sep 08 01:24:56.047249 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 672/1315] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:56 2022] GET /compute/v2.1/servers/4b31cbd2-eedd-43f7-9d1c-f08c0ed68dea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:24:56.187064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:56.188022 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: de12c6f0-dbcb-420c-9f16-143ee9c9d17a] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:56.196558 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:56.197042 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:56.197510 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:56.198273 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:56.198642 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:56.199064 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:56.205565 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-aa486e96-c0d0-47a9-a63a-b9f144dde035 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] Calling method '.version_select at 0x7fe9c9bc3ee0>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:56.214093 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] HTTP exception thrown: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Request method failure captured: Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a HTTP/1.1 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUKkd26l2JiFlASENj34o15D6JdzP4M3MSGUTC0p6onOQtY1glF6D9dU3iCwPWsJkCEnB-CLhdQ6ODgklCPvw0HTfwPv8eWOxp_cgrL-46iw8zhnrJRL7Ktcm421yYsRa6TBF8pb3zP_5mOsqu2wKgPdb3_tWfhy_bWTekoLAuJQka8 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:24:56.215942 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4221b10efb3d4bb799d820e985a48651", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4221b10efb3d4bb799d820e985a48651"}]}] Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestVolumeBootPattern-599965185 Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 744fe07ea5644157bdbf11d81adbab89 Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. Sep 08 01:24:56.217520 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': 'de12c6f0-dbcb-420c-9f16-143ee9c9d17a'} Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:24:56.221834 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. Sep 08 01:24:56.224218 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:24:56.225470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Returning 404 to user: Instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:24:56.225470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-fc367723-62d9-42f0-a6d7-0f85de8f34cb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a" status: 404 len: 111 microversion: 2.1 time: 0.034065 Sep 08 01:24:56.225470 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 644/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:56 2022] GET /compute/v2.1/servers/de12c6f0-dbcb-420c-9f16-143ee9c9d17a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:24:56.235493 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-aa486e96-c0d0-47a9-a63a-b9f144dde035 tempest-TestShelveInstance-589586563 tempest-TestShelveInstance-589586563-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1893073206" status: 202 len: 0 microversion: 2.1 time: 0.033649 Sep 08 01:24:56.236805 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 673/1317] 10.222.0.42 () {58 vars in 1254 bytes} [Thu Sep 8 01:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1893073206 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 01:24:56.458353 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de12c6f0-dbcb-420c-9f16-143ee9c9d17a", "name": "network-vif-deleted", "tag": "01e62ce5-f4b1-4017-b879-1bd62d631c51"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:24:56.467661 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:56.468154 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:56.468580 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:56.479625 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] Creating event network-vif-deleted:01e62ce5-f4b1-4017-b879-1bd62d631c51 for instance de12c6f0-dbcb-420c-9f16-143ee9c9d17a on hv-cinder-84773 Sep 08 01:24:56.484525 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-284b0515-76d3-4352-88b9-935acc02a1d5 req-653b8789-e483-4282-a15a-24e8ff8ff037 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029900 Sep 08 01:24:56.485285 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 645/1318] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:24:59.804009 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7941f2c-2db7-48f4-9349-520db58e9b22", "tag": "65a31114-bf80-4207-9670-9083d449f4b7"}]} {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:24:59.805579 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:59.806537 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:24:59.814566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:59.815566 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:59.816358 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:59.817582 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:59.818073 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:59.818519 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:59.819505 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:24:59.819971 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:24:59.820471 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:24:59.832471 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.compute.server_external_events [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] Creating event network-changed:65a31114-bf80-4207-9670-9083d449f4b7 for instance d7941f2c-2db7-48f4-9349-520db58e9b22 on hv-cinder-84773 Sep 08 01:24:59.839563 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [req-6b854338-88e2-48d2-a509-9d1607272540 req-cc9d52b5-6b1f-4d64-8d1a-04c251f3d03e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039968 Sep 08 01:24:59.847572 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 646/1319] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 01:24:59.860034 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Going to try to terminate instance {{(pid=120715) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 01:24:59.974132 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-d4895ee2-0f37-4e9f-95e1-df69c473c41a tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 204 len: 0 microversion: 2.1 time: 0.173753 Sep 08 01:24:59.975351 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 674/1320] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:24:59 2022] DELETE /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 01:24:59.986806 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:24:59.987529 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:00.000196 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:00.000699 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:00.001141 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:00.001854 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:00.002310 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:00.002736 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:00.195304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:25:00.203517 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-9083186b-1a7d-4323-967f-a86437f0beab tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1576 microversion: 2.1 time: 0.222276 Sep 08 01:25:00.204586 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 647/1321] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:24:59 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:25:01.231955 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:01.233382 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:01.240178 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:01.240984 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:01.241476 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:01.242240 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:01.242753 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:01.243235 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:01.534935 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.policy [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120715) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:25:01.543266 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-572e91cc-6d34-4b22-b1fb-47ff25ae2725 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1576 microversion: 2.1 time: 0.319789 Sep 08 01:25:01.543837 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 675/1322] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:25:01 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1576 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:25:02.568031 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:02.569180 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:02.577444 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:02.578116 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:02.578768 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:02.579628 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:02.580266 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:02.580870 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:02.608784 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7941f2c-2db7-48f4-9349-520db58e9b22", "name": "network-vif-deleted", "tag": "65a31114-bf80-4207-9670-9083d449f4b7"}]} {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 01:25:02.638466 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:02.639214 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:02.648341 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:02.662200 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.compute.server_external_events [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] Creating event network-vif-deleted:65a31114-bf80-4207-9670-9083d449f4b7 for instance d7941f2c-2db7-48f4-9349-520db58e9b22 on hv-cinder-84773 Sep 08 01:25:02.667558 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [req-d5d8880e-afa2-4825-ba90-ca5936d28ade req-0657e169-9037-46a4-b759-2a82e382f8ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063259 Sep 08 01:25:02.668562 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 676/1323] 10.222.0.42 () {64 vars in 1317 bytes} [Thu Sep 8 01:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 01:25:02.703280 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.policy [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744fe07ea5644157bdbf11d81adbab89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4221b10efb3d4bb799d820e985a48651', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120716) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 01:25:02.714231 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-0884c848-b62d-4f76-85eb-2b9ce1bb0e55 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 200 len: 1391 microversion: 2.1 time: 0.150961 Sep 08 01:25:02.715405 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 648/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:25:02 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 01:25:03.740769 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:03.741696 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: d7941f2c-2db7-48f4-9349-520db58e9b22] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:03.747898 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:03.748607 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:03.749276 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:03.751080 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:03.751713 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:03.752374 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:03.767300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] HTTP exception thrown: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Request method failure captured: Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 HTTP/1.1 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUKkd26l2JiFlASENj34o15D6JdzP4M3MSGUTC0p6onOQtY1glF6D9dU3iCwPWsJkCEnB-CLhdQ6ODgklCPvw0HTfwPv8eWOxp_cgrL-46iw8zhnrJRL7Ktcm421yYsRa6TBF8pb3zP_5mOsqu2wKgPdb3_tWfhy_bWTekoLAuJQka8 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:25:03.768979 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4221b10efb3d4bb799d820e985a48651", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4221b10efb3d4bb799d820e985a48651"}]}] Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 744fe07ea5644157bdbf11d81adbab89 Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. Sep 08 01:25:03.771692 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': 'd7941f2c-2db7-48f4-9349-520db58e9b22'} Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:25:03.772697 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. Sep 08 01:25:03.774300 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:03.775633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Returning 404 to user: Instance d7941f2c-2db7-48f4-9349-520db58e9b22 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:25:03.775633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-17a6bf32-faf1-48fd-9667-7a3ebd564bea tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22" status: 404 len: 111 microversion: 2.1 time: 0.036478 Sep 08 01:25:03.775633 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 677/1325] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:25:03 2022] GET /compute/v2.1/servers/d7941f2c-2db7-48f4-9349-520db58e9b22 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:04.275349 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:04.275905 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.compute.api [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120716) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:04.282337 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:04.282832 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:04.283261 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:04.284159 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:04.284608 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:04.285026 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG oslo_concurrency.lockutils [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:04.303277 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.wsgi [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] HTTP exception thrown: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Request method failure captured: Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: request: DELETE /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 HTTP/1.1 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept: application/json Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Accept-Encoding: identity Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Connection: close Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Length: 0 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Content-Type: application/json Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Host: 10.222.0.42 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: Openstack-System-Scope: None Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: User-Agent: python-urllib3/1.26.12 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Auth-Token: gAAAAABjGUKkd26l2JiFlASENj34o15D6JdzP4M3MSGUTC0p6onOQtY1glF6D9dU3iCwPWsJkCEnB-CLhdQ6ODgklCPvw0HTfwPv8eWOxp_cgrL-46iw8zhnrJRL7Ktcm421yYsRa6TBF8pb3zP_5mOsqu2wKgPdb3_tWfhy_bWTekoLAuJQka8 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Id: None Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Domain-Name: None Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Identity-Status: Confirmed Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Is-Admin-Project: True Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Id: default Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Domain-Name: Default Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Project-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Role: member,reader Sep 08 01:25:04.304977 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Roles: member,reader Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4221b10efb3d4bb799d820e985a48651", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4221b10efb3d4bb799d820e985a48651"}]}] Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-Tenant-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Id: default Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Domain-Name: Default Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Id: 744fe07ea5644157bdbf11d81adbab89 Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: X-User-Name: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: method: > Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: exception: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.306785 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: action_args: {'id': '585aa54c-7191-4b3d-bc77-4adf1090b504'} Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:25:04.307867 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.309464 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.311177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Returning 404 to user: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. {{(pid=120716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:25:04.311177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-2c60f130-798e-437a-a907-c47b136a07c2 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "DELETE /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 404 len: 111 microversion: 2.1 time: 0.034994 Sep 08 01:25:04.311177 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 649/1326] 10.222.0.42 () {58 vars in 1239 bytes} [Thu Sep 8 01:25:04 2022] DELETE /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:04.315974 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '>' {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:04.317213 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.compute.api [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] [instance: 585aa54c-7191-4b3d-bc77-4adf1090b504] Fetching instance by UUID {{(pid=120715) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 01:25:04.323510 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:04.324129 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:04.324612 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:04.325310 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Acquiring lock "399af677-d3da-4cd3-8ba5-6488df620aa9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 01:25:04.325765 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 01:25:04.326193 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG oslo_concurrency.lockutils [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Lock "399af677-d3da-4cd3-8ba5-6488df620aa9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120715) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 01:25:04.340672 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.wsgi [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] HTTP exception thrown: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Request method failure captured: Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: request: GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 HTTP/1.1 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept: application/json Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Accept-Encoding: identity Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Connection: close Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Length: 0 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Content-Type: application/json Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Host: 10.222.0.42 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: Openstack-System-Scope: None Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: User-Agent: python-urllib3/1.26.12 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Auth-Token: gAAAAABjGUKkd26l2JiFlASENj34o15D6JdzP4M3MSGUTC0p6onOQtY1glF6D9dU3iCwPWsJkCEnB-CLhdQ6ODgklCPvw0HTfwPv8eWOxp_cgrL-46iw8zhnrJRL7Ktcm421yYsRa6TBF8pb3zP_5mOsqu2wKgPdb3_tWfhy_bWTekoLAuJQka8 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Id: None Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Domain-Name: None Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Identity-Status: Confirmed Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Is-Admin-Project: True Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Id: default Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Domain-Name: Default Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Project-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Role: member,reader Sep 08 01:25:04.342218 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Roles: member,reader Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4221b10efb3d4bb799d820e985a48651"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4221b10efb3d4bb799d820e985a48651", "adminURL": "http://10.222.0.42:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4221b10efb3d4bb799d820e985a48651"}]}] Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Id: 4221b10efb3d4bb799d820e985a48651 Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-Tenant-Name: tempest-TestVolumeBootPattern-599965185 Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Id: default Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Domain-Name: Default Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Id: 744fe07ea5644157bdbf11d81adbab89 Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: X-User-Name: tempest-TestVolumeBootPattern-599965185-project Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: method: > Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: exception: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.344110 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: action_args: {'id': '585aa54c-7191-4b3d-bc77-4adf1090b504'} Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: {{(pid=120715) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 01:25:04.345128 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. Sep 08 01:25:04.346746 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: ERROR nova.api.openstack.wsgi Sep 08 01:25:04.348385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: DEBUG nova.api.openstack.wsgi [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Returning 404 to user: Instance 585aa54c-7191-4b3d-bc77-4adf1090b504 could not be found. {{(pid=120715) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 01:25:04.348385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: INFO nova.api.openstack.requestlog [None req-b47d13ab-f54a-408d-b5bd-94a8f4409537 tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504" status: 404 len: 111 microversion: 2.1 time: 0.031969 Sep 08 01:25:04.348385 dv-cinder-847733-3-iscsi devstack@n-api.service[120715]: [pid: 120715|app: 0|req: 678/1327] 10.222.0.42 () {58 vars in 1236 bytes} [Thu Sep 8 01:25:04 2022] GET /compute/v2.1/servers/585aa54c-7191-4b3d-bc77-4adf1090b504 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 01:25:05.638818 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: DEBUG nova.api.openstack.wsgi [None req-ce1d24ca-adf1-4706-8a6b-1d58e6aaa2bb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] Calling method '.version_select at 0x7fe9cd43aaf0>' {{(pid=120716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 01:25:05.664527 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: INFO nova.api.openstack.requestlog [None req-ce1d24ca-adf1-4706-8a6b-1d58e6aaa2bb tempest-TestVolumeBootPattern-599965185 tempest-TestVolumeBootPattern-599965185-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-979447183" status: 202 len: 0 microversion: 2.1 time: 0.029426 Sep 08 01:25:05.665304 dv-cinder-847733-3-iscsi devstack@n-api.service[120716]: [pid: 120716|app: 0|req: 650/1328] 10.222.0.42 () {58 vars in 1260 bytes} [Thu Sep 8 01:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-979447183 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)